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ABSTRACT 


This  report  describes  the  implementation  of  a  recursive, 
stochastic,  algorithm,  the  Least-Mean-Square  (LMS)  Error 
algorithm,  in  a  16- tap  weight  CCD  monolithic  analog  adaptive  filter 
with  electrically- reprogrammable  MOS  analog  conductance  weights. 

The  analog  and  digital  peripheral  MOS  on-chip  circuits  are 
provided  with  CMOS  technology. 


ACKNOWLEDGEMENTS 


We  would  like  to  express  our  appreciation  to  Westinghouse 
personnel,  F.  J.  Kub,  M.  Evey,  R.  Booth,  Dr.  G.  M.  Borsuk  and 
Dr.  D.  R.  Lampe  for  their  technical  contributions  during  the 
program  and  Dr.  P.  M.  Pan  for  his  support  of  CCD  Adaptive 
Signal  Processing.  We  would  like  to  specifically  express  our 
appreciation  to  Dr.  D.  F.  Barbe,  Navy  RSD  Office,  and  Dr.  W.  D. 
Baker,  formerly  of  NRL,  for  their  continued  support  of  CCD 
Programs  for  Signal  Processing.  A  special  thanks  to  Lisa  Moore 
for  assistance  in  the  preparation  of  the  final  report. 


< 


vii/viii 


I.  INTRODUCTION 


The  recommendation  of  an  early  study  program^  was  to  examine 

the  possibility  of  electrically  reprogrammable  analog  weights  at 

tap  positions  along  a  CCD  analog  delay  line  in  order  to  form  a 

basic  linear  combiner  for  adaptive  filtering.  A  step  was  taken 

in  this  direction  with  the  development  of  a  serial  in/parallel 
2 

out  (SI/PO)  CCD  with  a  floating  clock  electrode  circuit  for  the 

3 

attachment  of  conductance  weights.  The  latter  circuit  combined 

4 

the  advantages  of  MOS  and  bipolar  technologies  to  sense  non- 
destructively  the  signal  charge  under  a  floating  gate  electrode 
in  the  form  of  displacement  charge  stored  on  a  MOS  transistor 
amplifier. 5 


1 

M.H.  White  and  W.R.  Webb,  "Study  of  the  Use  of  Charge-Coupled 
Devices  in  Analog  Signal  Processing  Systems",  Final  Report, 
N00014-74-C-0069,  May  1974. 
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M.H.  White,  I. A.  Mack,  F.J.  Kub,  and  D.R.  Lampe,  "Charge-Coupled 
Device  Analog  Signal  Processing",  Final  Report  N0001 4-75-C-0283 , 
Feb.  1976. 
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M.H.  White,  I. A.  Mack,  F.J.  Kub,  D.R.  Lampe,  and  J.L.  Fagan, 

"An  Analog  CCD  Transversal  Filter  with  Floating  Clock  Electrode 
Sensor  and  Variable  Tap  Gains",  ISSCC  Technical  Digest  (1976), 
p.  194,  Philadelphia,  Pa.  ”  ~  ~ 

4 

F.J.  Kub,  M.H.  White,  D.R.  Lampe,  J.L.  Fagan,  and  I. A.  Mack, 
"CCD/Bipolar  Monolithic  IC  Technology",  Abstract  #107,  p.  207 
Extended  Abstracts,  Vol.  76-1,  Electrochemical  Society,  Spring 
Meeting,  May  2-7,  1976.  Washington,  D.C. 

5I.A.  Mack,  M.H.  White,  F.J.  Kub,  D.R.  Lampe,  and  J.L.  Fagan, 

"A  Versatile  CCD  Analog  Transversal  Filter  with  Floating  Clock 
Electrode  Sensors",  NAECON  76,  Dayton,  Ohio.  May  1976. 
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The  concept  of  electrically  reprogrammable  analog  conductance 

weights  was  introduced  with  the  use  of  non-volatile  MNOS  memory 

transistors  biased  in  their  triode  regions.  The  intent  of  this 

approach  was  to  realize  adaptive  filters  based  on  the  least-mean- 

0 

square  (LMS )  error  algorithm  to  optimize  the  weights  and  provide 

storage  of  the  weights  for  several  minutes  or  longer  based  upon 
■  .  .  9 

some  anticipated  applications.  In  addition,  many  applications 
required  a  large  number  of  tap  weights  which  placed  severe  limi¬ 
tations  on  the  use  of  multiplying  digital-to-analog  converters 

10  11  12 
(MDAC's)  at  each  tap  site  or  in  a  multiplexed  manner. 


M.H.  White,  D.R.  Lampe,  J.L.  Fagan,  "CCD  and  MNOS  Devices  for 
Programmable  Analog  Signal  Processing  and  Digital  Non-volatile 
Memory",  I EDM  Technical  Digest  (1973),  Dec.  1973,  p.  130-3. 

7 

D.R.  Lampe,  M.H.  White,  J.H.  Mims,  and  G.A.  Gilmour,  "CCD's 
for  Discrete  Analog  Signal  Processing",  INTERCON  74,  March  1974, 
New  York  City. 

g 

B.  Widrow,  "Adaptive  Filters  I:  Fundamentals"  Rept.  SEL-66-126 
(TR  No.  6764-6)  Stanford  Electronics  Labs  (Stanford,  Calif.) 

Dec.  1966. 

9 

M.M.  Sondhi  and  A.J.  Presti,  "A  Self-Adaptive  Echo  Canceller", 

B. S.T. J.  ,  1851  (1966). 

1  0 

J.L.  McCreary  and  P.R.  Gray,  "All  MOS  Charge  Redistribution 
Analog-to-Digital  Conversion  Techniques-Part  I",  IEEE  J.  of 
Solid  State  Circuits,  SC- 1 0 ,  371  (1975). 

^Y.A.  Haque  and  M.A.  Copeland,  "Design  and  Characterization  of 
a  Real-Time  Correlator",  IEEE  J.  of  Solid-State  Circuits,  SC-12, 
642  (1977)  . 

1  2 

C. F.  Cowan  and  J.  Mavor,  "Noise  Cancellation  and  Inverse  Filter¬ 
ing  Using  a  Compact  High-Performance  CCD  Adaptive  Filter", 
Electronics  Letters,  15,  35  (1979). 
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Our  experience  with  MNOS  memory  transistors^  for  over  a  de¬ 
cade,  since  1965,  and  the  long-term  endurance  of  these  devices  to 
1 4 

cycling,  made  the  non-volatile  transistor  a  logical  selection 
for  a  long-term  analog  storage  element  with  multiplying  capabili¬ 
ties.  In  addition,  we  had  worked  on  the  combination  of  CCD  and 

MNOS  technologies  to  achieve  a  monolithic  charge-addressed  memory 
1 5 

cell.  Thus,  we  constructed  a  2-tap  weight,  hybrid,  CCD  adaptive 

filter  based  upon  the  use  of  non-volatile  MNOS  memory  transistors 

1  6*”  1 8 

as  the  analog  convolver-type  weights.  The  results  of  these 

studies  indicated  the  feasibility  of  constructing  a  monolithic 
CCD  adaptive  filter  based  on  the  LMS  error  algorithm.  During  the 
study  of  the  2-tap  weight  CCD  adaptive  filter,  we  realized  the 
difficulty  in  obtaining  uniform  MNOS  analog  characteristics  and 
the  requirement  for  a  number  of  accurate  analog  programming  volt¬ 
ages  to  adjust  the  device  threshold  voltage.  These  difficulties 
off-set  the  long-term  storage  assets  of  the  MNOS  memory  transistor 
and  we  focused  on  a  new  concept  for  the  monolithic  implementation 


3M.H.  White  and  J.R.  Cricchi,  "Characterization  of  Thin-Oxide 
MNOS  Memory  Transistors",  IEEE  Trans.  Electron  Devices,  ED-19, 
2380  (1972)  . 

14  ... 

M.H.  White,  J.W.  Dzimianski  and  M.C.  Peckerar,  "Endurance  of 
Thin-Oxide  Nonvolatile  MNOS  Memory  Transistors",  IEEE  Trans. 
Electron  Devices,  ED-24,  577  (1977). 

1  5 

M.H.  White,  D.R.  Lampe,  J.L.  Fagan,  F.  J.  Kub,  and  D.A.  Barth, 

"A  Nonvolatile  Charge  Addressed  Memory  (NOVCAM)  Cell",  IEEE  J. 
of  Solid-State  Circuits,  SC- 1 0 ,  281  (1975). 

16M.H.  White,  K.  Petrosky,  I. A.  Mack,  L.  Lewis,  "Adaptive  CCD  Sig¬ 
nal  Processing  for  Sonar  Applications",  1977  Int'l  Symp.  on  Cir¬ 
cuits  and  Systems,  April  25,  1977,  Phoenix,  Arizona. 

1  7 

M.H.  White,  I. A.  Mack,  L.L.  Lewis,  G.M.  Borsuk,  "CCD  Adaptive 
Discrete  Analog  Signal  Processing",  Final  Report,  N0001 73-76-C- 
0147,  July  1977. 

1  8 

M.H.  White,  I. A.  Mack,  G.M.  Borsuk,  D.R.  Lampe,  F.J.  Kub, 
"Charge-Coupled  Device  (CCD)  Adaptive  Discrete  Analog  Signal 
Processing",  IEEE  J.  of  Solid-State  Circuits,  SC-14,  132  (1979). 


of  programmable  analog  conductance  weights,  namely,  the  bi¬ 
directional,  charge-control,  technique  which  employs  a  single- 
stage  CCD  structure  with  each  programmable  MOS  analog  conductance. 
The  storage  and  accumulation  of  weight  values  is  accomplished  with 
the  capacitance  associated  with  each  MOS  transistor,  and  is  there¬ 
fore  limited  by  the  thermal  leakage  currents;  however,  the  tech¬ 
nique  is  readily  integratable  on  a  monolithic  chip  and  the  weight 
values  may  be  dynamically  refreshed  once  they  are  optimized,  if 
long-term  storage  is  required  in  some  applications. 

This  report  is  a  summary  of  the  work  performed  to  realize  a 
16-tap,  CCD  Adaptive  Analog  Signal  Processor  which  uses  the  LMS 
Algorithm  and  is  implemented  as  a  monolithic  integrated  circuit 
with  CMOS  technology.  The  report  begins  with  a  historical  per¬ 
spective  of  the  LMS  algorithm,  followed  by  a  discussion  of  the 
monolithic  implementation  of  the  LMS  Adaptive  Signal  Processor, 
and  a  description  of  the  fabrication  technology,  applications  of 
the  chip,  and  a  final  section  of  conclusions.  This  development 
of  a  CCD  Adaptive  Analog  Signal  Processor  is  the  first  implementa¬ 
tion  of  such  a  structure  in  the  form  of  low  cost,  low  power,  in¬ 
tegrated  circuits  with  attendant  high  performance  and  reliability. 
This  structure  may  be  "pictured"  as  a  smart  microprocessor  in 
which  the  internal  parameters  (weights)  are  continuously  changed 
or  up-dated  to  optimize  a  system  performance  index. 


II.  LMS  ERROR  ALGORITHM 


The  history  of  adaptive  signal  processing  might  well  begin 

with  the  introduction  of  least  squares  estimation  theory  by  Gauss 
2 

and  Legendre  .  Gauss  introduced  this  technique  to  solve  a  large 

number  of  redundant  equations  and  extract  the  "most  probable 

values"  of  certain  astronomical  parameters.  Modern  adaptive  fil- 

3  4 

ter  theory  began  with  the  work  of  Kolmogorov  and  Wiener  on  the 
prediction  and  filtering  of  stationary  time  series.  The  Weiner/ 
Kolmogorov  work  provided  the  basic  design  criteria  for  optimal 
linear  filters  to  suppress  noise,  perform  signal  prediction,  and 
smooth  statistically  stationary  signals.  The  design  of  these  fil 

5 

ters  for  known  statistics  is  well  understood  ,  but  practical  con¬ 
siderations  places  limits  on  the  implementation  of  such  filters. 
Kalman  and  Bucy  extended  the  Wiener  work  to  consider  the  design 
of  time-varying  filters  for  nonstationary  signals.  In  general, 


1 

K.G.  Gauss,  Theory  of  Motion  of  the  Heavenly  Bodies,  Dover,  New 
York  (1963). 

2 

H.W.  Sorenson,  "Least-Squares  Estimation:  from  Gauss  to  Kalman", 
IEEE  Spectrum,  p.  63,  July  1970. 

3 

A.  Kolmogorov,  "Interpolation  and  Extrapolation  von  Stationaren 
Zufallingen  Folgen,"  Bull  Acad.  Sci.,  USSR,  Ser.  Math.,  5,  3 
(1941 ) .  ~ 

4 

N.  Wiener,  The  Extrapolation,  Interpolation  and  Smoothing  of 
Stationary  Time  Series,  Cambridge,  Mass,  MIT  Press  (1949). 

5Y.W.  Lee,  Statistical  Theory  of  Communication,  John  Wiley  6  Sons 
New  York  (i960) . 

^R.  Kalman  and  R.  Bucy,  "New  Results  in  Linear  Filtering  and  Pre¬ 
diction  Theory",  Trans.  ASME  (Ser.  D)  J.  Basic  Eng.,  83,  95 
(1961 )  .  . . .  ’ 
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these  types  of  filters  have  parameters  whose  values  are  deter¬ 
mined  by  apriori  information  on  the  signal  statistics.  The  so- 
called  Kalman  filter  represents  essentially  a  recursive  solution 
of  Gauss's  original  least-square  problem  in  which  the  computa¬ 
tional  benefits  of  modern  digital  computers  are  used  to  advan- 

.  7 

tage . 

Adaptive  filters  are  a  class  of  "learning  machines"  in  which 
the  filter  design  (i.e.,  weight  or  parameter  adjustments)  is  self¬ 
learning  and  based  upon  estimated  (measured)  statistical  charac¬ 
teristics  of  the  input  and  output  signals.  Adaptive  filtering 
based  on  a  recursive  algorithm  (correlation-cancellation  loop 

O 

CCL)  was  employed  in  the  RF  antenna  field  in  the  1950's.  Two 

groups  working  independently,  developed  techniques  for  adaptive 

interference  or  clutter  cancelling.  One  group  worked  on  radar  IF 

9 

sidelobe  clutter  cancellers  with  optimization  achieved  by  an 

algorithm  that  maximized  a  generalized  signal-to-noise  (SNR) 

.1  o 

ratio.  The  other  group  worked  on  a  self-optimizing  array  for 

control  systems  based  on  sampled  signals  and  a  least-mean-square 

1 1 

(LMS)  error  algorithm.  These  two  adaptive  algorithms,  although 
arrived  at  with  different  approaches  and  different  objectives, 
are  nevertheless  very  similar  since  they  both  derive  their  adap¬ 
tive  parameter  adjustments  by  sensing  the  correlation  between 


7 

A. G.  Carlton  and  J.W.  Follm,  "Recent  Developments  in  Fixed  and 

Adaptive  Filtering",  AGARDograph,  No.  21  (1956). 

g 

W.F.  Gabriel,  "Adaptive  Arrays-An  Introduction",  Pro c.  IEEE,  64 
23  9  (1976)  .  ”  . .  ~ 

9 

P.W.  Howells,  "Intermediate  Frequency  Side-Lobe  Canceller" 

U.S.  Patent  #3,  202,  990  Issued  Aug.  24,  1965  (Filed  May  4, 
1959)  . 

^S.P.  Applebaum,  "Adaptive  Arrays",  Syracuse  University  Res. 
Corp.  Rep.  SPL,  TR  66-1,  Aug.  1966. 

1 1 

B.  Widrow,  "Adaptive  Filters  I:  Fundamentals",  Standard  Univer¬ 
sity,  Tech.  Rept.  N.  6764-6,  Dec.  1966. 
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I 


! 

element  signals.  Thus,  both  algorithms  use  the  covariance  matrix 

of  the  set  of  system  inputs  and  both  converge  toward  the  optimum 

Wiener  solution.  In  this  report,  we  use  the  LMS  error  adaptive 

1 2 

algorithm  developed  by  Widrow  and  Hoff  of  Stanford  University 

in  1959.  Widrow,  in  a  recent  survey  and  tutorial  article  on  adap- 

1  3 

tive  noise  cancelling  ,  describes  the  work  performed  during  the 
1960's  by  he  and  his  colleagues  at  Stanford. 

The  adaptive  filter  operates  without  apriori  knowledge  of  the 
signal  statistics  and  the  filter  uses  the  available  data  to  de¬ 
sign  an  appropriate  filter.  The  general  form  of  an  adaptive  fil¬ 
ter  is  limited  by  practical  considerations  since  the  inversion 
and  storage  of  large  matrices  of  data  requires  a  sizeable  volume 
of  computer  space  and  real-time  signal  processing  is  difficult  to 

accomplish.  The  iterative  LMS  error  algorithm  of  Widrow  and 
1  2 

Hoff  requires  very  little  computer  time  for  memory  and  the  al¬ 
gorithm  is  suitable  for  real-time  processing  of  large  amounts  of 
data.  With  this  algorithm,  the  statistics  of  the  signals  are  not 
measured  explicitly  to  design  the  filter,  but  with  a  recursive 
algorithm,  the  weights  are  adjusted  automatically  with  the  arrival 
of  each  new  data  sample. 

ADAPTIVE  FILTER:  DIRECT  TECHNIQUE 

In  order  to  appreciate  the  degree  of  computation  required  in 
the  direct  approach  to  the  solution  of  the  least-square-estimation 
problem,  consider  the  adaptive  filter  shown  in  figure  1.  We 
treat  the  adaptive  system  as  a  discrete-time  system  with  the  in¬ 
stantaneous  error 


1  2 

B.  Widrow  and  M,  Hoff,  Jr.,  "Adaptive  Switching  Circuits",  IRE 
WESCON,  Conv.  Rec.  Pt.  4,  96  (1960). 

1  3 

B.  Widrow,  et.  al.,  "Adaptive  Noise  Cancelling:  Principles  and 
Applications",  Proc.  IEEE,  63,  1692  (1975). 
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Weights 


so-ca 
t  rep 


cross-correlation  between  the  desired  response  and 
erence  data  signal,  and  R  =  E  (xm_nxm_k)  is  t^ie 
matrix  describing  the  statistical  properties  of  th< 
signal.  The  important  feature  of  equation  (3)  is 
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quadratic  function  of  the  weights  and  may  be  considered  as  a  con¬ 
cave  hyperbuloidal  surface  in  N-dimensions ,  where  N  =  number  of 
weights.  The  process  of  weight  adjustment  is  to  minimize  the  MSE 
and  this  involves  decending  along  the  hyperbuloidal  surface  to 
reach  the  so-called  "bottom  of  the  bowl".  A  popular  method  to 
descend  along  this  surface  is  the  gradient  technique, 


VwE(e2  )  =  -2P  +  2RW  (4) 

w  in 

and  the  optimum  weight  vector,  generally  called  the  Weiner  Weight 
Vector,  is  obtained  by  setting  the  gradient  to  zero, 

"opt.  -  R',p  '5» 

and  the  minimum  MSE  is  obtained  with  the  substitution  of  equation 
(5)  into  (3)  to  yield. 


min  E  (e2)  =  E  (d2) 


(6) 


The  conventional  approach  used  to  solve  for  the  optimum 
weights  involves  a  two-step  process  computing  and  updating  the 
sample  convariance  matrix  with  a  block  of  data  and  then  solving 
equation  (5).  In  order  to  accomplish  this  computation,  various 

numerical  algorithms  have  been  investigated  such  as  triangulariza- 

14  15  16 

tion  ,  Levinson- Robinson  ,  Householder-transf ormation  ,  and 
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B.S.  Atal  and  S.L.  Hanauer,  "Speech  Analysis  and  Synthesis  by 
Linear  Prediction  of  the  Speech  Wave”,  J.  Acoustical  Soc.  An., 
50,  637  (1971). 

1  5 

J.D.  Markel,  "Digital  Inverse  Filtering-A  New  Tool  for  Formant 
Trajector  Estimation",  IEEE  Trans.  Audio  and  Electroacoustics, 
Aug 20,  129  (1972). 
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J.  Rogers,  "Digital  Inverse  Filtering  of  the  Speech  Waveform", 
Proc.  British  Acoust.  Soc. ,  2,  Spring  Meeting,  April  1973. 
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Gaussian  elimination.^  These  methods,  even  the  most  efficient 

one,  require  a  considerable  amount  of  hardware  for  real-time 
1  g_  'j  9 

operation  .  The  size  and  power  dissipation,  in  addition  to 

the  cost  factor,  is  a  principle  liability  in  the  so-called  direct 

approach  to  solving  equation  (5). 

The  applications  of  the  adaptive  filter  are  quite  broad  and 

perhaps  it  is  fair  to  classify  this  device  as  an  adaptive  signal 

processor.  The  selection  of  the  reference  and  desired  signals  in 

figure  1  determines  the  particular  class  of  applications.  For 

example,  if  d  were  derived  from  the  input  reference  signal  to 
m  20 

the  filter,  then  we  would  have  an  adaptive  linear  predictor. 

A  second  example  is  to  use  d^  for  a  signal  contaminated  with 

narrow-band  noise  while  the  reference  input  has  only  the  contami- 

2 1 

nating  noise,  thereby  realizing  an  adaptive  noise  canceller. 

ADAPTIVE  FILTER:  LMS  ALGORITHM  APPROACH 

An  alternative  approach  to  the  direct  technique  is  to  use  a 

well-known  recursive  stochastic  algorithm  known  as  the  least- 

1  2 

mean-square  (LMS)  error  adaptive  algorithm.  The  LMS  error  al¬ 
gorithm  is  a  practical  technique  for  determining  in  real-time  the 
optimal  weights  of  the  linear  combiner  in  figure  1 ,  which  minimizes 


1  7 

J.R.  Welch  and  J.D.  Oetting,  "Formant  Extraction  Hardware  Using 
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November  1973. 

1  8 

J.G.  Dunn,  "An  Experimental  Gigabit/Sec  Voice  Digitizer  Employ¬ 
ing  Adaptive  Prediction",  IEEE  Trans,  on  Comp.  Tech.,  Com-19, 
1021  (1972). 
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Voice  Processor  LSI/Organization  Optimization  Study,  S.E. 
Hutchings,  et.  al.,  TRW  Systems,  Final  Report  Contract  No. 

DCA  1 00-75-C-0020 ,  September  1975. 

20 

G.S.  Kang,  "Application  of  Linear  Prediction  Encoding  to  a 
Narrowband  Voice  Digitizer",  Naval  Research  Lab.  Report  7774, 
October  31,  1974. 
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B.  Widrow,  et.  al.,  "Adaptive  Noise  Cancelling:  Principles  and 
Applications,  Proc.  IEEE,  63,  1692  (1975). 
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the  MSE.  The  important  features  of  the  algorithmic  approach  to 
the  solution  of  equation  (5)  are,  (1)  no  explicit  measurement  of 
correlation  functions,  (2)  no  large  memory  storage  or  matrix  in¬ 
version,  and  (3)  the  accuracy  is  determined  by  the  statistical 
sample  size.  These  advantages  permit  an  adaptive  analog  signal 
processor  to  be  realized  as  a  monolithic  integrated  circuit. 

The  minimum  of  the  MSE  is  found  by  solving  equation  (4)  with 
the  method  of  steepest  descent.  The  weight  adjustment  of  the 
linear  combiner  is  performed  in  a  direction  proportional  to  the 
negative  of  this  gradient  expression.  The  difference  equation 
which  describes  this  process  in  real  time  is  given  as, 

Wk(m  +  1)  =  Wk  (m)  -  MVW  E  (e*)  (7) 

K 

where  n  is  a  factor  which  is  responsible  for  the  stability  and 
rate  of  convergence  of  the  filter.  Combining  equations  (1)  -  (4) 
and  (7)  we  can  write 


Wk(m  +  1)  =  Wk(m)  +  2y  E(emxm_k)  (8) 

t  h 

for  the  k:  tap.  This  expression  shows  that  the  incremental 

weight  update  is  a  cross-correlation  between  the  error  sequence 
and  the  input  reference  data  sequence.  The  concept  is  described 
by  a  cross-correlation  function  C?k  for  the  k*"*1  tap  position: 


0k 


e  x  , 
i  m  m-k 


(9) 


over  M  data  samples  which  represent  the  statistical  sample  size. 
Thus,  the  process  of  weight  optimization  can  be  pictured  as  the 
point  in  time  when  the  error  sequence  is  orthogonal  to  the  data 
sequence.  The  result  is  simply  the  implementation  of  the  ortho¬ 
gonality  principle  in  N-dimensions .  The  particular  form  of  the 

1 2 

LMS  algorithm,  introduced  by  Widrow  and  Hoff  ,  makes  the  approxi¬ 
mation 
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(10) 


thereby  eliminating  the  need  to  average  over  a  large 
data  samples,  which  requires  large  storage  or  memory 
Equation  (8)  may  now  be  written  as, 


block  of 
capacity . 


W.  (m  +  1)  =  w,  (m)  +  2Ue  x  ,  OD 

Krn  in -k 

22 

which  may  be  likened  to  a  correlation  cancellation  loop  (CCL) 

that  removes  or  cancels  from  the  output  signal  y  any  component 

of  the  primary  input  signal  dm  that  is  correlated  with  the  tapped 

data  reference  signal  x  .  The  cancellation  is  illustrated  in 

m 

figure  2  with  a  controlled  subtraction  of  the  tapped  reference 
output  from  the  primary  input  after  the  former  has  been  adjusted 
in  amplitude  to  maximize  its  correlation  with  the  latter.  The 
subtraction  process  continues  until  no  correlation  is  detected 
between  the  output  error  and  the  reference  input,  at  which  time 
the  mean  input  to  the  integrator  is  zero.  Thereafter,  the  inte¬ 
grator  output,  which  controls  the  amplitude  adjustment,  remains 
constant  unless  the  input  changes.  The  CCL  has  two  aspects:  (1) 
a  correlation  between  input  reference  signal  samples  of  the  form: 

x„  .x  ,  and  (2)  a  correlation  between  the  primary  and  reference 
m- j  m- k 

inputs  of  the  form:  d  x  .  . 

m  m-k 

In  order  to  realize  an  N-point  adaptive  filter,  N  such  CCL 
stages  are  cascaded,  as  illustrated  in  figure  2,  where  each  CCL 
stage  is  designed  to  cancel  a  component  of  the  primary  input  that 
is  correlated  with  the  delayed  version  of  the  reference  input. 

The  algorithm  described  by  equation  (8)  and  implemented  in  figure 
2  is  called  the  linear  LMS  algorithm.  It  requires  an  analog  de¬ 
lay  line  with  low  loss  and  nondestructive  taps  to  provide  delayed 
signals  (i.e.,  x^  =  x (m  -  1),  x^  =  x (m  -  2),  ...,  xN  =  x (m  -N) ) 
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D.R.  Morgan,  "A  Note  on  Real-Time  Linear  Prediction  of  Speech 
Waveforms",  IEEE  Trans.  Acoust.  Speech,  Siq.  Processing.,  AU-21, 
306  (1975). 
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I 


Analoq  Delay  Line 


Figure  2.  LMS  Adaptive  Filter  Implemented  With 
Linear  LMS  Algorithm 

at  the  tap  positions.  In  addition,  two  4-quadrant  analog  multi¬ 
pliers  and  an  integrator  or  storage  element  are  required  for  each 
CCL  stage. 

The  use  of  conventional  4-quadrant  analog  multipliers  to  im¬ 
plement  the  linear  LMS  algorithm  is  not  practical.  Such  devices 
are  generally  expensive  in  discrete  form,  consume  substantial 
power,  and  require  real  estate  on  an  LSI  chip.  They  also  lack 
accuracy  and  speed  which  combined  with  the  previous  factors  makes 
the  4-quadrant  analog  multiplier  difficult  to  realize  in  inte¬ 
grated  circuit  form.  Perhaps,  one  of  the  most  serious  drawbacks 
of  the  linear  approach,  is  the  variation  in  multiplier  performance 
due  to  inaccuracies  from  such  sources  as  dc  off-sets  from  tap  to 
tap.  From  the  standpoint  of  usage,  we  note  the  linear  LMS  al¬ 
gorithm  depends  upon  the  reference  input  power  level  and  is  there¬ 
fore  sensitive  to  the  variations  in  power  level,  which  determines 


the  convergence  speed  of  the  algorithm.  Thus,  it  is  important  to 
seek  a  solution  to  the  problem  of  4-quadrant  analog  multipliers 
at  each  tap  position. 

In  applications  where  a  large  number  of  multipliers  are  anti- 

23 

cipated,  such  as  long-distance  telephone  communication  ,  analysis 

2  4  —  2  6 

has  been  performed  that  indicates  the  analog  multipliers  may 

be  replaced  by  devices  which  can  be  implemented  inexpensively  and 
with  characteristics  quite  different  from  the  conventional  multi¬ 
plier.  The  convergence  of  the  filter  weights  with  nonideal  multi- 
2  6 

pliers  is  an  important  property  of  the  adaptive  filter  and  makes 
such  a  filter  very  attractive  for  integration  on  a  silicon  chip. 
Thus,  a  form  of  the  linear  LMS  algorithm,  which  employs  a  nonideal 
multiplier  of  the  form 

^  H2) 

2  4 

is  called  the  "clipped-data"  LMS  algorithm.  This  algorithm  may 
be  written  as, 

W.  (m  +  1)  =  W  (m)  +  2jje_  sgn(*  )  (13) 

*■  Krn  rn-k 

The  error,  em»  is  still  computed  with  amplitude  and  sign  infor¬ 
mation  (i.e.,  in  a  linear  manner),  whereas  the  polarity  of  the 
data  reference  signal  is  employed  to  determine  the  direction  of 
weight  adjustment.  The  non-linear  clipper  action  is  written 
mathematically  as. 
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*  0 


s9n(xm-k>  “  +1'  for  xm-k 

=  -1,  for  x  ,  <  0  (14) 

m-k 

The  N  linear  multiplications  can  be  replaced  by  N  conditional 

branch  operations  which  check  the  sign  of  x  ,  and  on  this  basis 

add  or  subtract  the  quantity  2/*em  from  (m)  .  This  elimination 

of  N  4-quadrant  multiplications  provides1 a  distinct  advantage  in 

the  speed  of  operation  for  the  clipped  LMS  algorithm  without  a 

sacrifice  in  the  level  of  convergence.  The  speed  of  adaptation 

24 

is  reduced  in  comparison  with  the  linear  LMS  algorithm  by  a 
factor  of  7T/2  for  signals  with  Guassian  statistics. 

The  polarity  of  the  reference  data  may  be  determined  by  a 
single  input  comparator  and  stored  in  a  serial  digital  delay  line 
with  non-destructive  parallel  outputs  as  illustrated  in  figure  3. 
The  delay  line,  as  described  later,  is  implemented  with  a  CMOS 
shift  register  with  parallel  outputs.  The  analog  reference  input 
is  sampled  and  stored  in  an  analog  delay  line,  implemented  with  a 
charge-coupled  device  (CCD)  characterized  by  independent  non¬ 
destructive  read-out  at  the  tap  locations  x1 ,  ...  xN>  The  analog 
and  digital  delay  lines  are  synchronously  clocked  and  each  clock 

interval  finds  the  analog  data,  x  ,  and  polarity  data,  sgn(x  ,  ) 

th  iTi"- x.  m  **  k 

available  at  the  k  tap  location.  The  clipped-data  LMS  algorithm 
is  implemented  with  the  binary  multiplication  of  the  quantities 
em  and  xm_^.  which  is  accomplished  by  the  Exclusive  Or  gates  shown 
in  figure  3.  The  output  of  the  Exclusive  Or  gates  controls  the 
Polarity  Switches  which  direct  the  weight  update  2 | |  in  an  in¬ 
cremental  or  decremental  manner.  The  output  of  the  filter,  y  , 
is  subtracted  from  the  primary  input,  d  ,  to  form  the  error,  e^, 
and  the  sign  is  obtained  with  a  comparator  and  the  amplitude  is 
obtained  with  a  scaling,  absolute-value  amplifier. 
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Figure  3.  Clipped-Data  LMS  Algorithm  Implementation  of 
Adaptive  Filter  With  Cascaded  CCL's 

The  electrically  reprogrammable  analog  multipliers  may  be 

27 

multiplying  digital-to-analog-converters  (MDAC's)  or  MOSFET's 

operating  in  their  triode  region,  where  they  perform  the  feature 

2  8 

of  an  electrically  programmable  analog  conductance.  In  the 
construction  of  the  CCD  Adaptive  Signal  Processor,  the  MOSFET 
approach  is  used  because  of  its  simplicity  and  accuracy  as  an 
analog  multiplier.  The  disadvantages  of  this  approach  are  the 
absence  of  long-term  weight  storage  (i.e.,  weights  must  be  stored 
on  the  gate  capacitance  of  the  MOSFET  as  accumulated  charqe) , 


__ 

Y. A.  Haque  and  M. A.  Copeland,  "Design  and  Characterization  of  a 
Real-Time  Correlator",  IEEE  J.  of  Solid-State  Circuits,  SC-12, 
642  (1977) .  ~  .  '  ' 


M. H .  White,  I. A.  Mack,  G.M.  Borsuk,  D.R.  Lampe ,  and  F.J.  Kub, 
"Charge-Coupled  Device  (CCD)  Adaptive  Discrete  Analog  Signal 
Processing",  IEEE  J.  of  Solid-State  Circuits,  SC- 1 4 ,  132  (1979) 


and  the  dc  off-sets  from  tap-to-tap  which  cause  non-uniformities 

in  the  multipliers.  The  algorithm,  described  in  equation  (13), 

eliminates  the  need  for  N  four-quadrant  analog  multipliers  and 

replaces  these  multipliers  with  conditional  branching  operations 

that  are  readily  implemented  with  switches.  The  bidirectional 

3 

charge-control  circuit  (BC  )  responds  to  the  action  of  these 
switches  to  increment  or  decrement  an  amount  of  charge,  which  is 
proportional  to  the  amplitude  of  the  error  signal,  on  the  gate 
capacitance  of  the  MOSFET  analog  multiplier.  The  integration 
is  accomplished  with  the  temporary  storage  features  of  the  gate 
insulator  of  the  MOSFET. 

LMS  CLIPPED  DATA;  ALGORITHM  CHARACTERISTICS 

In  this  section  we  will  discuss  several  aspects  of  the  LMS 
algorithm  as  applied  to  the  "clipped-data"  implementation.  The 
two  essential  characteristics  discussed  are  (1)  transient  response 
and  (2)  frequency  selectivity.  The  transient  response  relates  to 
the  speed  of  convergence  to  achieve  a  desired  accuracy,  and  the 
final  steady-state  weights  of  the  filter.  The  influence  of  ref¬ 
erence  and  desired  signal  amplitudes  (including  noise)  on  the 
transient  response  are  particularly  important  in  the  understanding 
of  the  algorithm  operation.  The  frequency  selectivity  is  also  of 
importance  because  the  separation  of  narrowband  and  broadband 
signals  is  accomplished  by  the  operation  of  the  adaptive  signal 
processor  on  correlated  components  of  reference  and  desired  signals 

( 1 )  TRANSIENT  RESPONSE  OF  ALGORITHM 

In  this  section,  we  will  present  a  simple  analysis  of  a  2-tap 
weight  adaptive  filter  under  the  control  of  the  "clipped-data" 

LMS  algorithm.  Figure  4  illustrates  a  block  diagram  of  the  adap¬ 
tive  filter.  We  will  analyze  this  adaptive  filter  for  a  sinu¬ 
soidal  signal  in  the  presence  of  white  noise.  The  analysis  is 
performed  for  continuous  signals,  rather  than  ^ampled-data  sig¬ 
nals,  in  order  to  simplify  the  time  averaging;  however,  the  gen¬ 
eral  results  are  applicable  to  samplod-data  operation.  A  second 
simplification  is  the  use  of  time-averaging  in  order  to  simplify 
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Figure  4.  A  2-Tap  Weight  Adaptive  Filter  With 
"Clipped  Data"  LMS  Algorithm 

the  mathematics.  The  continuous  time  representation  of  equation 
(13),  without  the  Widrow-Hoff  approximation,  is  written  as, 


2\i  e  (t)  x  ( t  -  jT) 


The  desired  signal  may  be  written  as, 


(15) 


d  ( t)  =  dQ  cos  (  «ot  +  #  )  (16) 

where  ^  is  a  relative  phase-shift  with  respect  to  the  signal  at 
tap  1.  The  tapped  reference  signals  are, 

x1  (t)  =  xq  cos  (trt)  +  n1  (t)  (17) 

(t)  =  xq  cos  [  u)(t  -  T )  ]  +  n2  (t) 
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X 


where  T  is  the  time  delay  between  tap  positions  and  n^  (t)  ,  n2  (t) 
are  uncorrelated  noises  at  the  tap  positions.  The  matrix  elements 
of  the  covariance  matrix  (see  equation  3)  become. 


Xj(t)  sgnfX^t)] 


=  (s+n^ )  sgn  (s+n^) 


s  sgn  s  +  n^  sgn 


where 

n  2(t)  =  n  2(t)  -  *  2 
1  £  n 

n1(t)n2(t)  =  sn  =  sn^  =  0 


(18) 


(19) 


Calculation  of  the  remaining  matrix  elements  yields 

2X 

Xj(t)  sgn[X2[t)]  =  X2(t)  sgnfX^t)]  =  — 2  cos  u>  T 


_  2d 

d(t)  sgn [ X j(t)J  = 

_  2d 

d(t)  sgn[X2(t)]  =  ~ 


cos  <i> 


cos  (wT  +  d>) 

which  yields  the  weight  equation  (see  equation  15): 

fzx. 

,  ,  -  \  A  A  (  COS  $  ^ 

d  /  \  4^d 


W 


1 


dt 


W. 


o 

7T 


-2fil 


cos(wT-)  $)/ 


:x  rz  i  ca 

— -  +  %—  <7  1  - -  coswT 

7T  ■  IT  n  I  7T 

1  f? 

;os  wT  1  a 

I  7T  »  7T  n 


(20) 


The  above  equation  for  the  weights  illustrates  the  cross-coupling 
between  the  taps  caused  by  the  delay  T  and  when  ooT  =  (2k+1)7T/2, 
k  =  0,  1,  2...  the  system  is  decoupled  and  in  so-called  normal 
form.  We  can  transform  the  weights  into  a  normal  coordinate  sys¬ 
tem  with 


W  =  <t>  n 


(22) 
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where 


4>  = 


(23) 


is  the  transformation  matrix.  Application  of  this  transformation 
to  equation  (21)  yields 


±(n-i 

dt  Hn 


4jx  d 


o  I  cos  J>_-_c£S_(w  T  _+  J>]_ 


(24) 


2X 


2[i 


s[2  n  \  COS  <j)  +  cos  (u  T  +  <j>) 

(I  -  cos  w  T)  c r 

7T  1  7T  n 


2X 


( 1  t  cos  w  Tl 


With  equations  (22)  and  (24)  we  can  write  the  transient  weight 
response  of  the  normal  weights  in  terms  of  time  constants 


2k 


2X 


l  7 r 


(1  -  coswT)  + 


{i  . 

~  7r  n  J 


(25) 


f  2X 

2k  (1  +  coswT) 

and  a  steady  state  solution  for  the  weights  becomes 

^^cosi  -  X^  coswT  cos  (coT+$)J 

(Xo  +Vf  ^n)2  4  COs2“T 

dof(XQ4Vf  "^jcos  (wT  +$  )  -  X  cos^  cos  wT  j 

(Xo  +Vi  an  )2  +  cos2  wT 


W^s.s.) 


W2(s.s.) 


(26) 
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”1 


which  we  observe  is  a  function  of  frequency  providing  o>T  /  (2k  + 
1)7T/2,  k  =  0,  1,  2,  ...  When  this  condition  is  approached,  the 
optimal  weights  approach  the  values, 


W  (opt.  ) 


W  (opt. 


d  cos  $ 
o 


X  +J: 

IT 

r  a 

o  1 

Z  n 

(27) 


■d  sin  <£ 
o _ 

<  +  Jj  a 

o  f  2  n 


ioTi(2k+l)?r/2 


and  the  weights  are  decoupled  from  one  another  as  the  coordinate 

system  approaches  normal  form. 

29 

Glover  has  analyzed  the  particular  case  when  there  is  a  90- 
degree  phase  shil i  between  the  weights  for  adaptive  noise  cancel¬ 
ling  in  the  form  of  a  notch  filter.  He  showed  when  a  sum  of  sin¬ 
usoids  is  applied  to  an  adaptive  filter,  the  filter  converges  to 
a  dynamic  solution  in  which  the  weights  are  time  varying.  This 
time-varying  solution  gives  rise  to  a  tunable  notch  filter  with 
a  notch  located  at  each  of  the  reference  frequencies.  In  the  ex¬ 
ample  considered,  the  desired  and  reference  inputs  were  operating 

29 

at  the  same  frequency  (i.e.,  f^  =  fr) .  Glover  showed  for  f 
f  the  weights  have  a  dynamic  steady-state  response  with  an  oscil 
lation  at  the  difference  frequency  f^  -  f^  and  the  instantaneous 
response  at  f  .  This  time-varying  solution  should  not  be  con¬ 
sidered  as  noise  in  the  adaptation  process.  In  essence,  the  time 
varying  weights  modulate  the  reference  frequency  f  and  heterodyn 
it  into  the  desired  frequency  f^,  thus,  creating  a  notch  effect. 


29 

J.R.  Glover,  "Adaptive  Noise  Cancelling  of  Sinusoidal  Inter¬ 
ference",  Naval  Underseas  Center,  San  Diego,  Calif.  Rept  #  TN 
1617,  Dec.  1975.  (Stanford  University  Ph.D.  Thesis). 
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(2)  A  2-TAP  ADAPTIVE  FILTER 

In  this  section  we  will  examine  a  simple  single-frequency 
noise  canceller  with  2-adaptive  weights  under  the  operation  of  the 
"clipped  data"  LMS  algorithm.  Figure  5  illustrates  the  single 
frequency  noise  canceller  in  which  the  desired  input  may  be  any 
type  of  signal  (i.e.,  stochastic,  deterministic,  periodic,  transi¬ 
ent,  or  combination  thereof)  while  the  input  signal  is  a  pure  co¬ 
sine  wave  XQ  cos  (<^Qt  -0)  .  The  desired  and  input  signals  are 
sampled  synchronously  at  f  =  1/T  with  a  90  degree  phase  between 
X.j  and  X^  taps.  The  algorithm  for  updating  the  weights  is, 


Wj  (m  +  1)  =  Wj  (m)  +  2\±e  (m)  sgn  [X  (m)J 

W^(m)+  1)  =  W  (m)  +  2^6  (m)  sgn  [X_  (m)] 
where. 


(28) 


X1(m)=XoCos(Wonir-0)  (29) 

X  (m)  =  X  sin  (to  mT  -  A) 
c,  O  O 

The  first  step  in  the  analysis  is  to  consider  the  adaptive 
noise  canceller  as  a  feedback  network  with  the  filter  output  Y (m) 
disconnected.  Under  these  conditions,  a  unit  impulse  at  m  =  k  is 
applied  at  the  desired  input  to  create  an  error. 


!1  m=k 

(30) 

0  m^k 

The  transfer  function  of  the  incremental  weight  change  may  be 
written  as. 


z  j  W  (m  +  1)  -  W  (m)  }  =  (Z-l)  Wj  (Z)  (31) 

or 

W  1  (Z)  -  U(Z)  z  \  2(i€  (m)  sgn  [Xj  vm)]|  (3  2) 
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Figure  5.  Single  Frequency  Adaptive  Noise  Canceller 


where  U(Z)  =  (Z-1)  .  The  impulse  response  of  U(Z)  is  the  step 


response , 


u(m-l ) 


1  m  >  1 


0  m  <  1 


Convolution  of  u(m-1)  with  2fi  e  (m)  sgn  [x^(m)]  yields  the  weight. 


W^(m)  -  Zm-  sgn  [cos  (w^  kT  -  $)] 
and  the  corresponding  filter  output  is. 


m>k  +  1  ( 3 1| 


Y  (m)  =  2\i  X  cos  (w  mT  -  $)  sgn  [  cos  (w  kT  -  $)1  m>k+l 
1  oo  L  o  J  (35 


Similarly, 


Y  (m)  =  2m-  X  sin  («  mT-^)  sgn  f  sin  (w  kT-^)1  m>k+l 

l  o  o  o 


rnrnmmm 


with  the  total  output, 


Y(m)  =  Yj(m)  +  Y^m)  =  LC°S  ^  0mT  ’  ^  ^  sSn  f-cos  ^  0kT  ‘  ^  0 

+  sin  (w  mT  -  <j>)  sgn  [sin(w  ^kT  -  <£)]J  m  >  k+1  (37) 

Equations  30  and  37  may  be  Z-transf ormed  to  yield  the  pulse  trans¬ 
fer  function. 

G(Z,  k)  =  2(i  V2  X 

°  Z  -  2Z  cos  u  T  +  1 

°  (38) 

where  0°  <  ktooT  ~<t>  —  7T/2,  since  the  above  transfer  function  re¬ 
peats  every  90  degrees.  In  the  above  form,  G(Z,k)  is  nontime- 
invariant,  and  in  order  to  remove  the  k-dependence,  we  will 
average  over  the  period  indicated  to  obtain 

_  8  (i  X  (Z  cos  co  T-l) 

G‘(Z)  = - — - 2 -  (39) 

*  Z  -  2Z  cos  to  T+l 

o 

Since  the  closed-loop  transfer  function  is 


H(Z)  = 

(  '  D(Z ) 


1  +  G(Z ) 


with  closed-loop  zeroes  given  as 


Z  = 


±  j  w  T 
e  o 


(41) 


and  poles  from  t  ie  solution  of  1  +  G (Z)  =0.  If  we  make  the  nar¬ 
rowband  approximation  with  ja  Xq  <  1 ,  then  the  poles  are  inside 
the  unit  circle  with  a  radial  distance,. 


(42) 


from  the  origin  as  shown  in  figure  6.  The  angles  of  the  poles  are 
almost  identical  to  those  of  the  zeroes  with  a  notch  filter  band¬ 
width 


Z  ■  Plane 


E(CJ) 
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a)  Poles  and  zeroes  of  2-tap  weight  adaptive  noise  canceller 


b)  Magnitude  of  Filter  Transfer  Function 
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Fiqure  6.  Characteristics  of  a  2-Tap  Weight  Adaptive  Noise 
Canceller  Under  the  Control  of  a  Clipped  Data  LMS  Algorithm 


B.  W. 


8  n  X 
_ o 

TT  T 


(43) 


with  a  Q , 

o  w  T 

o  :  2_  =  JL  _°_ 

U  B.W.  8  fj-  X 

o 


A  special  case  of  the  notch  filter  is  to  set  u> 
tions  39  and  40  to  yield 


(44) 

0  in  equa- 


H(Z,  «  =  0) 

o 


Z  -  1 

^Xo 

Z  -  (1  -  8  -  ) 

7T 


(45) 


which  places  the  notch  at  zero  frequency  to  cancel  low  frequency 
drift.  Since  there  is  no  need  to  match  the  phase  of  the  signal, 
only  one  weight  is  needed.  The  bandwidth  is  given  by  equation  43 
and  the  transfer  function,  expressed  by  equation  45,  indicates  a 
pole- zero  separation  of. 


8>**o 

7 r 


on  the  real  axis.  The  use  of  a  bias  weight  can  remove  slowly 
varying  drift  components  in  the  input  signal  and  may  be  used  simul¬ 
taneously  with  operation  to  cancel  periodic  or  stochastic  inter¬ 
ference. 


2-22 


III.  CCD  MONOLITHIC  ADAPTIVE  SIGNAL  PROCESSOR 


ADAPTIVE  FILTER  GENERALIZED  BLOCK  DIAGRAM 

Illustrated  in  figure  7  is  a  generalized  block  diagram  of  an 
adaptive  filter  for  a  sampled  data  system.  The  input  reference 
signal,  x(t),  and  desired  signal,  d(t),  are  continuous  time  sig¬ 
nals  which  are  converted  to  sampled  data  system  format  via  the 
sample  and  hold  circuit  at  each  input.  The  signals,  which  are 
selected  for  the  reference  and  desired  inputs,  will  be  determined 
by  the  adaptive  filter  application.  Section  V  describes  these 
application  areas. 

The  samples  of  the  reference  signal,  x^,  are  applied  to  an 
N-stage,  tapped,  delay  line.  The  output  of  each  tap,  x  ,  is 
multiplied  by  an  adjustable  weight,  W^,  and  an  output  signal, 
ym,  is  formed  via  the  simultaneous  summation  of  the  weighted 
products,  to  yield 

Ym  =  Wk  Xm-k  (1) 

which  is  the  discrete  convolution  of  the  tap  weights  and  tapped 
delay  line  outputs.  The  transversal  filter  output  is  subtracted 
from  the  desired  signal  to  form  an  error  signal,  e  ,  which  is 
applied,  together  with  the  reference  signal,  x^,  to  an  algorithm 
which  adjusts  all  weights  simultaneously  at  each  clock  iteration 
until  the  mean-squared-error  (MSE)  is  minimized.  The  weight  con¬ 
trol  algorithm  used  on  this  monolithic  adaptive  filter  chip  is 
the  "clipped-data"  LMS  algorithm  and  requires  that  the  weight  at 
the  kth  tap  location  during  the  m^  clock  period  be  updated 
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J.L.  Moschner,  "Adaptive  Filter  with  Clipped  Input  Data', 
Stanford  Lab.  Rep.  6796-1,  June  1970. 


TAPPED  DELAY  LINE 


.re  7.  Adaptive  Filter  Block  Di 


according  to  the  equation, 


Wk  (m  +  1)  =  wk(m)  +  2fxem  sgn(xm_k)  (2) 

where , 

e  =  d  -  y  (3) 

m  m  '  ' 

which  is  explained  in  Section  II. 

In  order  to  see  the  development  of  the  monolithic  chip,  we 

may  rewrite  equation  (2)  as 

m 

W.  (m  +  1)  =  Wt(0)  +  2p  I  sgn  (x .  )  sgn(e.)  |e.j 

*  *  j=l  3“k  i  J  (4) 

over  m  data  samples,  which  represents  the  statistical  sample  size 
(e.g. ,  see  equation  (9)  in  Section  II) .  Equation  (4)  describes 
the  basic  requirements  to  implement  the  adaptive  filter,  namely, 

1.  At  each  clock  period,  j,  the  sign  of  the  error,  e,  and 
the  sign  of  the  reference  data  at  each  tap  position,  Xj_k,  must 
be  determined. 

2.  At  each  clock  period,  j,  the  weight  at  each  tap  location, 
Wk(m),  must  be  incremented  with 

sgn  (x  .  _k)  sgn(e^.)  >  0 

or  decremented  with 

sgn(xm_k)  sgn(e..)  <  0 

by  an  amount  2  fi  •  |  e ^  |  ,  where  "fi"  is  the  convergence  factor. 

3.  The  weight  value  at  each  tap  location  must  be  the  inte¬ 
grated  sum  of  all  previous  weight  increments  and  decrements. 

A  storage  element  is  therefore  required  at  each  tap  location. 

A  detailed  block  diagram  of  the  monolithic  adaptive  filter 
chip,  incorporating  the  above  requirements  is  shown  in  figure 
8.  Operation  of  the  circuit  will  be  described  with  reference 
to  the  features  shown  in  the  figure. 


3-3 


ANALOG  OE LAY  LINE  (B) 


Block  Diagram  of  Monolithic  Adaptive  Filter 


(1)  The  analog  signal,  x(t),  is  converted  to  a  sampled  data 
format,  which  is  compatible  with  the  architecture  of  the  analog 
delay  line,  by  the  input  formatter  circuit. 

(2)  The  formatter  output  voltage,  x  ,  is  applied  to  the  input 
of  a  p-channel  CCD  analog  delay  line,  operating  in  the  so-called 
"surface-channel"  mode.  The  input  voltage  is  converted  to  charge 
with  a  stabilized  charge  injection  circuit  and  the  resulting 
charge  packet  is  transferred  along  the  length  of  the  CCD  (Charge- 

3 

Coupled  Device)  by  a  2-1/2  phase  clocking  sequence. 

(3)  At  each  tap  location,  the  charge  packet  is  nondestruc- 
tively  sensed  and  converted  back  to  a  voltage  by  a  floating  clock 

4 

electrode  sensor  circuit. 

(4)  Each  tap  output  voltage  is  multiplied  by  a  programmable 

analog  conductance  multiplier  which  converts  the  output  voltage 

to  a  weighted  current.  An  analog  signal  processor  simultaneously 

sums  all  currents,  performs  current  to  voltage  conversion  with  a 

transconductance  amplifier,  and  a  clamp/sample  operation  produces 

the  transversal  filter  output,  y  .  The  error  is  formed  by  sub¬ 
til 

tracting  y^  from  d^,  a  sampled  version  of  the  desired  input  sig¬ 
nal. 

(5)  The  algorithm  requires  three  operations  to  be  performed 
on  the  error: 

(a)  Form  the  absolute  value  of  the  error,  j | 


2 

M.H.  White,  D.R.  Lampe ,  F.C.  Blaha,  and  I. A.  Mack,  "CCD  and  MNOS 
Devices  for  Programmable  Analog  Signal  Processing  and  Digital 
Nonvolatile  Memory",  1973  IEEE  Int'l  Electron  Devices  Meeting 
( IEDM) .  Washington,  D.C. 

^M.H.  White,  I. A.  Mack,  G.M.  Borsuk,  D.R.  Lampe,  and  F.J.  Kub, 
"CCD  Analog  Adaptive  Signal  Processing”,  1978  Int'l  Conference 
on  the  Applications  of  CCD's" ,  San  Diego,  Calif.  '  “ 
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M.H.  White,  I. A.  Mack,  F.J.  Kub,  D.R.  Lampe,  and  J.L.  Fagan, 

"An  Analog  CCD  Transversal  Filter  with  Floating  Clock  Sensor  and 
Variable  Tap  Gains",  1976  IEEE  Int’l  Solid-State  circuits  Conf., 
(ISSCC),  Philadelphia,  Pa. 
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(b)  Scale  the  error  by  2/t 

(c)  Form  the  sign  of  the  error,  sgn(e  ) 

m 

The  sign  of  the  error  is  formed  by  a  comparator  and  is  subse¬ 
quently  used  in  an  absolute-value  circuit.  The  absolute  value 
circuit  output  is  scaled  by  a  factor  "K",  where  "K"  contributes 
to  the  overall  convergence  factor,  2H. 

(6)  To  eliminate  the  requirement  of  a  comparator  at  each  tap 
location  to  form  sgn(xm_^),  a  single  comparator  is  employed  at 
the  adaptive  filter  input  to  form  the  sign  of  each  reference  in¬ 
put  signal.  The  comparator  output,  sgn(xm),  is  inputted  to  a 
digital  shift  register,  which  is  clocked  in  unison  with  the  cor¬ 
responding  analog  samples  in  the  CCD. 

(7)  The  sgn (x  .  )  sgn(e  )  product  is  formed  in  an  Exclusive 

m-  k  m 

OR  circuit,  with  one  Exclusive  OR  circuit  for  each  CCD  tap  re¬ 
quired.  The  Exclusive  OR  circuit  provides  a  binary  multiply  of 
the  delayed  sign  of  the  reference  input  signal  and  the  sign  of 
the  error,  with  N  such  multiplies  accomplished,  in  parallel,  for 
each  clock  period.  The  output  of  the  Exclusive  OR  circuit,  at 
each  tap  location,  determines  whether  or  not  the  particular 
weight  in  question  will  be  incremented  or  decremented.  A  steering 
network,  at  each  tap  location,  programs  the  electrode  configura¬ 
tion  of  a  Bidirectional  Charge  Control  Circuit  ( BC to  either 
increment  or  decrement  the  weight  by  adjusting  the  polarity  of 
the  quantity,  2 H  |e  |. 

DESCRIPTION  OF  BASIC  COMPONENTS 

The  following  sections  will  illustrate  the  operation  of  the 
basic  components  which  are  incorporated  on  the  monolithic  chip 
of  the  CCD  Adaptive  Signal  Processor. 

A.  INPUT  FORMATTER  CIRCUIT 

The  input  formatter  circuit  converts  the  continuous  time  ref¬ 
erence  input  signal,  x(t) ,  into  a  sampled  data  signal  with  a  for¬ 
mat  compatible  with  the  organization  of  the  CCD  tapped  delay  line 
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and  the  format  requirements  of  the  correlated  double  sampling 
(CDS)  circuit  which  is  located  in  the  clamp/sample  operation  of 
the  analog  signal  processor.  With  reference  to  figure  9a  the 
circuit  operation  is  as  follows: 

(1)  "AC  Zero"  Clamp  Operation 

With0I  high  and  are  conducting  while  Q1  is  off,  allow¬ 
ing  C  (=10  pF)  to  charge  to  the  ac  zero  or  CCD  so-called  "fat- 
zero"  voltage,  VFZ- 

(2)  Signal  Sample  Operation 

With  <(> ^  low,  conducts  while  and  are  off.  With  no 
input  sample,  this  permits  C  to  "float”  and  to  act  as  a  battery 
with  a  voltage  relative  to  the  input,  providing  the  "off" 

resistance  of  the  switches  and  the  capacitance  have  a  time  con¬ 
stant  which  is  long  compared  with  the  input  sampling  frequency. 
With  a  signal  x(t)  applied  to  the  input,  the  input  to  the  ampli¬ 
fier  becomes  the  signal  voltage  x(t)  superimposed  upon  the  voltage 
across  the  capacitor  C.  If  the  input  signal  is  "riding”  on  a  dc 
level,  Xdc,  the  amplifier  output  voltage,  in  the  absence  of  ampli¬ 
fier  offsets  and  clock  feedthroughs,  which  are  reduced  with  the 
use  of  "dummy"  transistors  Q,.  and  Q&,  is  given  by 


signal  +  AC  zero":  X'  =  x  +  X.  +  V 
^  m  m  dc  FZ 


(5) 


"AC  zero":  X’  =  V„„ 
m  fz 

where  consists  of  two  parts  during  the  mth  clock  period.  Fig¬ 
ure  9b  shows  a  photomicrograph  of  the  input  formatter  and  figure 
10  illustrates  the  continuous  time  input  and  the  resulting  "signal 
+  AC  zero"  and  "AC  zero"  formatted  output. 


5 

M.H.  White,  D.R.  Lampe,  I. A.  Mack,  and  F.C.  Blaha,  "Characteri¬ 
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Figure  10.  Input  Formatter  Circuit  Operation 
B.  TAPPED  ANALOG  DELAY  LINE 

The  CCD,  which  is  used  as  a  tapped  analog  delay  line,  is  a 

p-type,  Surface  Channel,  structure  and  is  shown  in  figure  11  along 

with  the  associated  timing  diagram.  The  input  signal,  x^,  is 

converted  to  a  charge  and  injected  into  the  CCD  with  a  stabilized 

2 

charge  injection  circuit  to  provide  low  noise,  linear  operation. 
Subsequently,  the  charge  is  clocked  along  the  CCD  in  the  manner 
described  in  figure  11a.  The  clocking  scheme  and  electrode  con¬ 
figuration  is  designed  to  minimize  the  complexity  of  the  circuitry 
needed  to  generate  the  CCD  clocks  and  also  to  minimize  <$>  ^  clock 
feed- tnroughs  to  the  sensing  node  of  the  floating  clock  electrode 
sensor  circuit.  These  feed-throughs  are  minimized  by  inserting  a 
"shield"  between  the  <t>  2  clock  electrode  and  the  sensing  electrode. 
The  "shield"  is  provided  by  the  dc  voltage,  V  ,  on  one  side  of 
the  sensing  node,  and  by  the  low  "on"  resistance  of  the  (f)  ^  clock 
driver  on  the  other  side  of  the  sensing  node.  We  examine  the 
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operation  of  the  nondestructive  sensing  circuit  with  reference 
to  figure  11a.  At  time  (T)  ,  a  charge  pacKet  is  in  "wells"  under 

electrodes  clocked  by  0 ^  and  02,  while  the  sensing  electrode  is 
reset  to  by  the  reset  switch,  enabled  by  0_.  At  time  (2)  , 

l  i  KK  R 

aru^  0R  have  been  pulsed  to  a  voltage  near  substrate  poten¬ 
tial,  forcing  charge  over  the  potential  barriers  controlled  by  a 
dc  voltage,  VpG,  and  under  the  sensing  electrode  of  the  floating 
clock  electrode  sensing  (FCES)  circuit.  The  charge  packet  causes 
a  change  in  surface  potential,  which  is  sensed  on  the  gate  of  MOS 
FET  Q^.  At  time  (3)  ,  after  stabilization  of  the  voltage  on  the 

sensing  electrode,  a  clamp  (sample)  operation  is  performed  in  the 
CDS  circuit.  At  time  @  ,  the  cycle  is  repeated  by  enabling  0^, 

<t>R,  and  02. 

The  FCES  circuit  is  composed  of  the  reset  switch,  sensing 
amplifier,  Q^r  source- follower  load  amplifier,  Q^,  and  an  emitter- 
follower,  bipolar  transistor,  for  a  low-output  impedance  buffer. 
The  source-follower  configuration  minimizes  tap-to-tap  gain  vari- 
ations  in  contrast  with  inverting-type  configurations.  The  N- 
channel  MOSFET  with  gate-control  voltage,  VpD,  is  connected  in 
parallel  with  the  tap-weight  (not  shown)  in  order  to  "sink"  the 
dc  bias  current  of  the  bipolar  transistor.  This  minimizes  the 
voltage  drop  across  the  analog  conductance  MOSFET  tap  weight 
and  the  current-sinking  requirements  of  the  summing  transconduct¬ 
ance  amplifier. 

The  2-1/20  CCD  clock  technique  provides  a  simplified  timing 
sequence  and  reduces  clock  feedthroughs  as  compared  with  a  4-0 
clock  sequence®;  however,  there  is  a  reduction  in  charge-handling 
capability  and  transfer  efficiency  which  is  not  a  restriction  in 
the  present  design.  The  maximum  desired  output  from  each  tap  is 
approximately  0.2  V  peak-to-peak  to  maintain  the  MOSFET  analog 


6Final  Report,  "CCD  Adaptive  Discrete  Analog  Signal  Processing", 
Contract  No.  N001 73-76-C-O 1 47 ,  July  1977. 


conductance  multiplier  in  a  linear  region  of  operation7  and  a 
large  charge-handling  capability  is  not  essential.  The  maximum 
frequency  of  sampled  operation  is  approximately  100  KHz  and  trans¬ 
fer  efficiency  above  these  frequencies  is  not  required  in  the 
processor.  This  limit  is  imposed  by  the  bandwidth  of  the  analog 
operational  amplifiers  which  determines  the  time  required  to 
reach  at  1  percent  accuracy  (settling  time)  in  the  clamp/sample 
operation  of  the  analog  signal  processor.  A  photomicrograph  of  a  non¬ 
destructive  readout  circuit  (NDRO)  for  CCD  signal  charge  is  shown 
in  figure  11b,  while  the  impulse  response  at  the  1st,  8th,  and 
16th  taps  is  illustrated  in  figure  12. 

C.  MOS  PROGRAMMABLE  ANALOG  CONDUCTANCE  WEIGHT 
The  circuit  used  to  implement  a  programmable  analog  conduct¬ 
ance  weight  is  illustrated  in  figure  13.  The  variable  weighting 

function  is  performed  by  a  MOS  Transistor  biased  in  the  triode 
8 

region  with  an  initial  multiplication  determined  by  the  analog 
onductance , 

9DS  *  *  Co  (W/W  (VGS  -  V  (6) 

where  fx  is  the  effective  carrier  (electron)  mobility,  CQ  the 
effective  oxide  capacitance/area,  W/L  the  width- to-length  ratio, 

VGS  the  effective  gate-to-source  voltage,  and 

VT  =  VT0  +  (VBS  +  ^ ^  *1/2]  (7) 


7 

D.R.  Lampe,  H.C.  Lin,  M.H.  White,  I. A.  Mack,  "Fourier  Analysis 
Computer  Aided  Design  (CAD)  of  CCD  Signal  Processing  Analog 
Multipliers  Arrays",  1976  Conference  on  CCD  Technology  and 
Applications ,  Washington,  D.C. 

Q 

M.H.  White,  I. A.  Mack,  G.M.  Borsuk,  D.R.  Lampe,  and  F.J.  Kub, 
"Charge-Coupled  Device  (CCD)  Adaptive  Discrete  Analog  Signal 
Processing",  IEEE  J.  of  Solid-State  Circuits,  SC- 1 4 ,  132  (1979). 
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CCD  INPUT 


TAP  1  OUTPUT 

TAP  8  OUTPUT 

TAP  16  OUTPUT 


Figure  12.  CCD  Tapped  Delay  Line  Input  and  Output  Waveforms 
V'm  k 


Figure  13.  Weight  Circuit 


where  VTQ  is  the  zero-bias  (VRS  =  0)  threshold  voltage,  the 
surface  potential  in  strong  inversion  <6  =  2 <t>„,  V_,0  the  bulk  to 

1 /2  r  Bb 

source  bias,  and  X  =  (2K  e  qN)  /  /C  ,  the  so-called  "body-factor". 
The  tapped  delay  line  output  voltage  is  multiplied  by  gDS>  the 
drain- to-source  analog  conductance  of  the  N-channel  MOSFET,  and 
the  resulting  current  is  converted  to  a  voltage  by  operational 
amplifiers  OAl  or  OA2,  depending  upon  the  signal  path  from  the 
tapped  output  voltage.  In  order  to  realize  a  positive  or  negative 
effective  weight,  two  MOSFET' s  must  be  used  at  each  tap  location. 
The  gate  voltage,  V~w  of  one  MOSFET  is  adjusted  so  its  fixed 


conductance  bisects  the  dynamic  range  of  the  programmable  conduct¬ 
ance  with  designated  gate  Voltage,  V*  .  This  latter  conductance 
represents  the  programmable  weight  which  is  connected  to  the  BC3 
circuit.  Thus,  the  function  of  V^w  is  to  vary  above  or  below  the 
value  of  V„w  in  order  to  determine  an  effective  positive  or  nega¬ 
tive  weighted  voltage  at  the  output,  vq (m) .  The  effective  weight 
is  given  by  the  expression, 


Vm>  *  Vota)/xm-k  =  r|  Rt  *  Co(W/U  [VGW(m>  -  VGw)  <7’ 

if  the  individual  resistors,  W/L  's,  etc...  are  matched. 

The  gate  voltage  of  the  variable  analog  conductances  can  be 

3 

controlled  by  the  output  of  the  BC  circuit  or  programmed  ex¬ 
ternally  with  Wext  by  the  action  of  and  dc  enable  gate  sig¬ 

nal,  VWR,  on  the  external  program  enable  transistor.  With  the 
16  taps  on  the  CCD  at  their  maximum  differential  conductance 
(i.e.,  approximately  15  Kfi  per  tap  weight),  and  a  0.2  V  peak-to- 
peak  excursion  at  each  tap  location,  the  maximum  value  of  vq (m) 
is  approximately  4.3  V  when  all  resistors  equal  20  kQ,  which  is 
within  the  common-mode  range  of  the  CMOS  Operational  Amplifiers 
operating  at  +7.5  V  supply  voltages. 
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D.  CORRELATED  DOUBLE  SAMPLING  (CDS)  AND  DIFFERENCE  CIRCUIT 
In  reference  to  figure  14  the  circuitry  enclosed  within  the 
dotted  lines  is  the  CDS  circuit^  which  is  employed  to  difference 
the  "ac  zero"  and  "Signal  +  ac  zero"  formatted  signal  appearing 
at  the  output  of  the  "weighting"  circuit.  For  implementation  on 
a  monolithic  chip,  the  CDS  circuit  could  have  been  realized  by 
connecting  the  clamp  capacitor,  Cc,  directly  to  the  sampling 
switch  (controlled  by  <£g)  in  order  to  eliminate  the  amplifier  0A4 
This  approach  has  two  major  drawbacks,  namely,  (1)  the  sampled 
signal  is  attenuated  by  capacitive  voltage  division  between  the 
clamp  and  sample  capacitors  (i.e.,  by  the  ratio  Cc/(Cc+Cs)),  and 
(2)  a  "dump"  switch  to  ground  across  Cg  is  required  to  initialize 
the  sample  capacitor  prior  to  each  new  sample  acquisition.  This 
would  result  in  additional  timing  waveform  complexity  and  an  addi¬ 
tional  "level"  in  the  output  waveform.  The  use  of  the  buffer 
amplifier,  although  consuming  more  power,  provides  a  voltage 
source  driver  for  the  sample  capacitor,  which  eliminates  the  need 
for  a  dump  switch  and  provides  a  continuous  output  signal  over 
the  sample  interval. 


Figure  14.  CDS  and  Difference  Circuit 


The  output  signal,  y  ,  is  the  transversal  filter  output. 
During  the  y-channel  sampling  interval,  the  desired  signal,  d(t), 
is  also  sampled.  This  action,  although  band-limiting  the  d- 
channel,  provides  a  complementary,  stationary,  signal  to  the  dif¬ 
ference  amplifier.  The  error,  e  =  d  -Y  ,  is  formed  by  the  dif- 
ference  amplifier  0A7  with  resistor  values  of  R?,  Rg  =  10  Kft,  Rg , 
R10  =  20  KQ.  Operational  amplifiers  OA4,  OA5 ,  and  OA6  function 
as  unity-gain  buffer  amplifiers  in  the  voltage-f ollower  mode. 

E.  ABSOLUTE  VALUE  CIRCUIT 

The  absolute  value  circuit,  shown  in  figure  15a,  uses  sgn(em) 
to  control  the  transfer  function  of  an  operational  amplifier, 

OA8.  The  sign  of  the  error,  e  ,  is  determined  by  an  operational 
amplifier,  Ce,  which  is  operated  in  the  open- loop,  high-gain, 
mode  as  a  comparator.  In  this  mode  the  internal  compensating 
capacitor  is  removed  in  order  to  ensure  maximum  gain  at  a  speci¬ 
fied  clocking  rate.  The  output  of  Cg  is  translated  to  a  low- 
level,  logic  signal  (0  to  +7.5  V)  with  a  CMOS  inverter  pair  to 


Figure  15a.  Absolute  Value  Circuit 


provide  complementary  drive  signals  to  a  +7 . 5  V  level  shifter 
which  in- turn  provides  the  necessary  drive  signals  to  the  CMOS 
transfer  gates,  T1  and  T2.  When  the  error  signal  e^  >  0,  node  1 
of  the  level  shifter  is  negative  while  node  2  is  positive.  Thus, 
T1  and  Q2  are  OFF,  while  T2  and  are  conducting  or  "ON".  This 
places  the  amplifier  in  a  non- inverting  configuration  with  the 
transfer  function, 


m  i 


m 


ON 


R 

Tf2) 


1)  +  r12  +  r13 


1  + 


14 


RON  ^ 


+  R 


—  e  >  0 
1 1  _ £ — 


(8) 


With  the  input  signal  <  0,  T1  and  Q2  are  conducting,  ON,  while 
Q 1  and  T2  are  OFF.  This  places  the  amplifier  OA8  in  an  inverting 
configuration  with  the  transfer  function, 
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14 


R0N(T1 


+  R 


1  1 


e  < 
ra 


(9) 


The  resistors  of  the  operational  amplifier,  designed  for  20  Kfi, 
are  much  larger  than  the  ON  resistance  of  the  MOS  transistors 
when  driven  with  the  15V  range  of  the  level  shifters.  Thus, 
there  is  very  little  gain  difference  between  the  inverting  and 
non-inverting  configurations.  A  photomicrograph  of  the  absolute 
value  circuit  is  shown  in  figure  15b  and  the  circuit  operation  is 
illustrated  in  figure  16. 
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Figure  15b.  Photomicrograph  of  Absolute  Value  Circuit 


Figure  16.  Absolute  Value  Circuit  Operation 
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F.  SCALING  AMPLIFIER 

The  output  of  the  absolute  value  circuit  is  applied  to  an  in¬ 
verting  amplifier  with  an  off-chip  resistor  to  allow  external 
selection  of  the  convergence  factor,  /z  .  The  output  of  the  scaling 
amplifier  is  the  analog  signal  which  determines  the  magnitude  of 
the  weight  change  at  each  tap  location. 

G.  OPERATIONAL  AMPLIFIERS 

The  operational  amplifier  is  a  primary  component  of  the  CCD 
adaptive  signal  processor  because  it  is  utilized  in  many  different 
operations.  One  amplifier  design  is  used  as  the  basis  for  a  com¬ 
parator,  buffer  or  voltage- follower  amplifier,  difference  ampli¬ 
fier,  absolute-value  amplifier,  scaling  amplifier,  and  current- 
to-voltage  converter.  Twelve  amplifiers  are  used  to  realize  these 

g 

various  functions.  The  amplifier  design  ,  shown  in  figure  17a 
with  a  photomicrograph  shown  in  figure  17b,  is  based  upon  design 


Figure  17a.  CMOS  Operational  Amplifier  Schematic 


Figure  17b.  Photomicrograph  of  CMOS  Oporat lonal  Amplifier 

(12  Mils  x  If  Mils) 


g 

practices  employed  in  bipolar  amplifiers  ,  where  NPN  bipolar 
transistors  become  NMOS  transistors  and  lateral  PNP  bipolar  tran¬ 
sistors  become  PMOS  transistors.  Tims,  CMOS  design  ^  is  quite 
analogous  to  bipolar  design  with  internal  frequency  compensation 
provided  by  the  capacitance  C  in  a  special,  source-follower,  buf¬ 
fered  2nd  stage.11 


9 

J.E.  Solomon,  "The  Monolithic  Op  Amp:  A  Tutorial  Study", 

IEEE  J.  of  Solid  State  Circuits,  SC- 9,  314  (197-.). 

10G.F.  Landsburg,  "A  Two-Chip  CMOS  CODEC",  IEEE  Solid-State  Mr- 
cuits  Conference ,  1  978  ,  p .  1 8 0 .  ~ . 

1 1 Y . P .  Tsividis  and  P.R.  Gray,  "An  Integrated  NMOS  Operational 
Amplifier  with  Internal  Compensation",  IEEE  J.  Solid-State  Cir¬ 
cuits,  SC-11,  748  (1976) 
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The  CMOS  amplifier  has  an  input  differential  stage  with  PMOS 
input  transistors  to  provide  low  off-set  voltages  and  low  1/f 
noise.  The  differential  input  to  single-ended  output  is  accom¬ 
plished  with  active  loading  formed  by  NMOS  transistor  M4 .  The 
output  of  the  differential  stage  is  applied  to  a  high-gain  CMOS 
leve  1- si'.  1  f ter/gain  stage  formed  by  the  inverter  M8-M9  whose  out¬ 
put,  at  node  9,  is  fed  back,  to  the  inverter  input  (node  4)  by 
means  of  a  unity  gain  buffer  (source-follower)  stage  formed  by 
.“.o  and  M7 .  T.he  source- fol lower  buffers  the  compensation  capacitor 
C  to  reduce  the  pnase  shift  associated  with  the  forward  transmis¬ 
sion  in  the  gain-stage  M8-M9.  The  emitter-follower  output  stage 
provides  a  low  output  impedance  for  driving  with  a  fast  positive 
slewing  rate.  Ml  2  must  be  selected  so  as  to  sink  the  discharge 
current  from  the  load  capacitance,  which  sets  the  limit  on  the 
negative  slewing  rate.  The  input  stage  differential  drain  cur¬ 
rents  determine  the  internal  slewing  rate  with, 


DS 


wit:,  t  /:  real  values  of  12  V/>  sec  resulting  from  I  =  36  fi  A  and 

L/O 

C  >■  :>F .  the  external  slewing  rate  is  sot  by  the  drain  current 
o f  M It  with 


I  (Ml  2) 
o_ 

"ext.  ~  C  ,  ’  " 

wifi  *.  ;;ac  il  values  of  12  V  /i  sec  resulting  from  I  =  300  /i  A  and 
a  load  canac :  tar.ce  C,  25  pF,  where  V+  -  +7.5V  and  V  =  -7.5V. 

L, 

fable  1  illustrates  the  design  goals  and  performance  obtained  for 
tf,‘-  operational  Anpl  i  tiers. 

,  "  '  ‘  ,  ; :  . :  1  •  :  ■  i  :•  i  v- • ;  >  a-n -<i  i  v  i  tier  to  sot  tin 

-td  .i  .  .i  •  •  :.<  *:•>•/  i.odt  .>  5  and  f.  in  the  circuit  of  figure 

1  ;  h«.  •; ;  :ni  !  leant.  ! «  at  ui  e  of  the  design  is  that  no  ground  (com¬ 

mon  >  i  ;>  present  in  the  amplifier  through  which  substantial  cur¬ 
rent  can  flow  anu  cause  noise  problems.  A  common-mode  range  of 
4  1  V  funitos  m !»  to  remain  in  the  pentode  (saturation)  region 
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when  node  9  is  at  5  V,  while  M8  and  Ml  2  must  remain  in  saturation 
when  nodes  9  and  12  reach  -5  V.  Since  pentode  or  saturation  re¬ 
quires. 


GS 


-  Vm  <  V 


DS 


when  we  have  +7.5  V  supplies  and  Vmvi  =  1.3  V,  this  means  node  6 
must  be  at  3.8  V  and  nodes  3,  4  and  5  must  be  at  -3.8  V.  The 
current  sources  M5  and  M6  are  biased  by  node  6  to  minimize  the 

TABLE  1 

CMOS  OPERATIONAL  AMPLIFIER  V+  =  +7.5  V,  V~  =  -7.5  V 


Parameter 

Design  Goal 

Measured 

Open  Loop  DC  Gain 

60  dB 

70  dB 

Unity  Gain  Frequency 

1  MHz 

2.0  MHz 

Phase  Margin 

45° 

45° 

Slewing  rate  (+) 

(CL  =  25  pF.) 

+  10  V/fisec 

+  10  V/fisec 

Off-set  Voltage 

<  20  mV 

<  5  mV 

Power  Dissipation 

15  mW 

12  mW 

Amplifier  Size 

200  mil2 

170  mil2 

Common-Mode  Rejection 

4  0  dB 

50  dB 

Common-Mode  Range 

+  5  V 

+  5  V 

number  of  bias  settings  required  and  are  sized  to  meet  the  cur¬ 
rent  requirements  of  the  input  and  buffer  stages.  The  geometry 
of  the  devices  is  set  by  the  slewing  rate  requirements  and  de¬ 
sired  power  dissipation,  within  a  specified  amplifier  size.  Table 
2  lists  the  W/L  ratios  for  the  transistors  in  the  circuit  of  fig¬ 
ure  1  7 . 

The  open  loop  dc  gain,  phase  margin,  slew  rate,  etc.,  are  all 
related  to  the  compensation  capacitor  C  which  determines  the 
stability  of  the  amplifier.  An  analysis  of  the  amplifier  shown 
in  figure  17a  yields  the  open  loop  gain, 
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Vs)  = 


1  +  sc 


[l  +  sC/gJ 


+  R 


Jm1 


o4 


(10) 


where  Ay(0)  =  <3m-]'?mgR04R09  Is  low-frequency  dc  open-loop  gain, 

and  the  output  impedances  are, 
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o4 


1 

^ds4  +  ^ds2 


effective  output 
impedance  at  node  4 
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o9 


*ds8 


Jds9 


effective  output 
impedance  at  node  9 


For  ( 0 )  >  >  Rq4  +  1/g  equation  (10)  reduces  to 


(ID 


(1  +  sC/g  -) 

Ay(s)  =  \r(0)  j  +  sC  ^(oj/g^ 


TABLE  2 

(CMOS  OPERATIONAL  AMPLIFIER  MOS  TRANSISTOR  W/L  RATIOS) 


Transistor 

Desired 

W/L  Ratio 
(microns) 

Mask 

W/L 

(microns) 

Ml 

M2 

83/10 

83/13 

M3 

M4 

33/10 

33/13 

M5 

M6 

50/10 

50/13 

M7 

133/10 

133/13 

M8 

96/1  2 

96/15 

M9 

70/12 

70/1  5 

Ml  0 

50/15 

50/18 

Ml  1 

1  5/30 

15/33 

Ml  2 

150/5 

150/8 

Q 1  3 

Bipolar 

Bipolar 

Ml  4 

50/15 

50/18 

Q 1  5 

Bipolar 

Bipolar 
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and 


where  the  effect  of  the  pole  is  minimized  by  maximizing  g  ^ 
minimizing  C  subject  to  the  constraints  of  bandwidth  and  slew 
rate.  We  note,  the  bandwidth  and  slew  rate  are  given  by. 


BW  =  gml/27rC 
Slew  rate  =  2IDg/C 


(13) 


and  the  transconductance  of  the  MOS  FET  is  related  to  the  drain 
current  by  the  expression, 
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DS 


Jm1 
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GS 


V„ 


2  tfoW 


1/2 


(14) 


which  illustrates  the  interrelationship  between  the  two  quantities. 
The  selection  of  g  ^  is  determined  by  the  need  to  provide  low  out¬ 
put  impedance  and  provide  sufficient  current  for  M7  so  as  not  to 
limit  the  slew  rate  of  the  amplifier,  while  the  channels  of  MOS 
transistors  M8  and  M9  must  be  selected  to  minimize  output  conduct¬ 
ance  (maximize  output  impedance  RQg) . 

The  bipolar  transistor  can  provide  the  necessary  current 

for  the  positive  slewing  rate  requirements;  however,  the  current 
sink  Ml  2  must  be  selected  to  provide  the  necessary  current  for 
the  negative  slewing  rate  requirements.  The  feedback  transistor 
Q15  limits  the  negative  excursion  on  the  base  of  Q13  to  a  diode 
drop  below  the  output  voltage.  With  this  feature,  the  output 
voltage  cannot  overshoot  on  a  negative  slewing  response  and  "lock" 
at  the  negative  rail. 

Table  2  indicates  the  final  design  W/L's  for  the  various  MOS 

Transistors;  however,  after  the  mask  layouts  were  completed,  the 

lengths  were  3  /xm  oversize  to  allow  for  lateral  diffusion  and 

undercut  during  fabrication.  Devices  Q13  and  015  are  parasitic 

vertical  NPN  bipolar  transistors  formed  in  the  p_  tub  used  for 

the  N-channel  MOS  Transistors.  Circuit  simulation  was  performed 

12... 

with  the  ISPICE  Circuit  Simulation  Program  and  the  device  models 


1  2 

,  ISPICE  is  a  Circuit  Simulation  Program  available  from  National, 

a  division  of  CSC  (Computer-Science  Corporation),  on  t imo- 
i  share. 

i 

* 


1 


are  shown  in  table  3,  while  the  device  sizes  are  shown  in  table  2. 

With  the  device  models  of  table  3  the  CMOS  amplifier  shown  in 
figure  17a  was  analyzed  for  small- signal ,  ac,  frequency  response. 
The  transient  response  of  a  voltage  follower  was  also  simulated 

TABLE  3 

(ISPICE  MODELING) 


MOD  FI  PhD:  P I C  M  1  V  T  D  =  1 .3  PH I =.58  UD=c,Fm  NB=1E15  C0=3.4F-8«- 
C 1  -<-■ .  PF - 1  c  C?  =  F..8F-1?  fp.ri=7.7:-:F-l?  CF  3  =  7 . 78F-  1  c'  PB=.68  13= IF- 148 
K  M  =  .  0 3  hh=l.fi  KL=1 .5  FC  P I  T=  1 . ?4F5  BE TR=3. 75E-6  GRMMh=  .  54$. 

L  H  h  E  It  H  -  1  .  15E-4> 

MODEL  HMDS  MS  CM  ■  VTD=  1 . 3  PH  I  =  .  76  IJCN550  NB=  1 . 5E 1 6  CD=3.4E-8t 
Cl  =8.  8E-1S'  Cc'-P. .  8F-  1 F  C  BD  =  E'E'F-  18  CB 3  =SEF -  1 E  PB=.84  IS=1E-14S- 
KM=.  0  03  MM=  1 . 58  Kl.=  t,58  EC  p  I  T  =  3. 35F5  FETh-9. 37E-6  GRMMFl-E.lt 
LhMBDh  =  c  .  9E -5.-1 

with  the  results  for  both  simulations  shown  in  table  4.  The  fre¬ 
quency  response  was  examined  for  various  compensation  capacitors 
C  and  the  transient  response  was  simulated  for  a  5  V  input  step 
into  a  voltage  follower,  unity-gain,  buffer  amplifier  driving  a 
load  capacitance  of  CT  =  25  pF. 

i_j 

A  photomicrograph  of  the  CMOS  Operational  Amplifier  is  shown 
in  figure  17b.  In  the  first  mask  designs,  the  compensation  capa¬ 
citor  was  made  programmable  with  any  combination  of  the  values  1 , 

2,  and  4  pF;  however,  based  upon  simulation  (see  table  3)  a  selec¬ 
tion  of  1  pF  was  used  in  the  early  fabrication  runs.  This  was 
quite  unfortunate,  since  the  dc  circuit  simulation  and  experi¬ 
mental  results  agreed  quite  closely,  while  the  ac  circuit  simula¬ 
tion  was  significantly  different  from  the  experimental  measurements. 
The  dc  simulation  and  experimental  results  are  illustrated  in 
table  5. 

The  ac  performance  of  the  amplifier  is  critically  dependent 
upon  the  output  conductance  modeling  of  the  MOS  Transistors  and 
the  capacitance  modeling  within  the  MOS  Transistor.  The  1  pF 
compensation  capacitor,  which  was  selected  for  the  initial  masks, 
was  insufficient  to  achieve  stable  amplifier  operation  when  the 
closed  loop  gain  became  less  than  15  dB.  Thus,  with  painstaking 
effort,  an  investigation  was  conducted  to  determine  the  necessary 
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TABLE  4 

(ISPICE  CMOS  OPERATIONAL)  AMPLIFIER  SIMULATION 
V+  =  +7.5V  V~=  -7.5V  C  =  2  5  pF 


Compensation 

Capacitance 

C  pF) 

Open-Loop  Low  Frequency 
Voltage  Gain  Av(0) 

4 

63  dB 

2 

1 

0 

Unity  Gain  Frequency 

(MHz) 

2.15 

3.83 

4.65 

11.0 

Phase  Margin 

79° 

68° 

58° 

22° 

Gain  Margin  (dB) 

-30 

-25 

-20 

-10 

Slewing  rate  (V//i sec) 

22 

25* 

25* 

25* 

♦Limited  by  external 

current 

supplied 

to  load 

capacitance 

TABLE  5 

(DC  SIMULATION  AND  EXPERIMENTAL  MEASUREMENTS  FOR  CMOS  OPERATIONAL 
AMPLIFIER:  V+  =  +7.5V  V~=  -7.5V) 


Simulated 

Experimental 

Open-Loop  DC  Gain 

Voltage  Gain  A^O) 

63  dB 

65  -  70  dB 

Input  Off-Set  Voltage 

V  Referred  to  Input 

os 

0. 4  mV 

(no  mis-match 
assumed) 

1  -  5  mV 

Power  Dissipation 

16  mW 

12  mW 

1  3 

modifications  to  achieve  amplifier  stability  .  The  result  of 
these  studies  showed  that  an  external  5  pF  capacitor  added  to  the 
internal  1  pF  compensating  capacitor  and  a  1  pF  capacitor  connected 
across  the  output  of  the  high-gain  inverter  stage  (i.e.,  from 

T3 

In  a  thesis  by  G.  Smarandoiu,  "Nonlinear  Converters  for  Pulse- 
Code-Modulation  Systems"  College  of  Engineering,  University  of 
California,  Berkeley,  California,  considerable  SPICE  simulation 
was  performed  on  CMOS  Buffer  Amplifiers  with  C  =  1 0  pF  compen¬ 
sation  capacitors. 
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node  9  to  ground  in  figure  17a  resulted  in  a  stabilized  amplifier. 
Table  6  illustrates  the  final  ac  results  obtained  for  the  stabil¬ 
ized  CMOS  Operational  Amplifier.  The  small  signal  and  large  sig¬ 
nal  (transient  step  response)  characteristics  of  the  amplifier 
are  illustrated  in  figure  18. 


TABLE  6 

(CHARACTERISTICS  OF  COMPENSATED  CMOS  OPERATIONAL  AMPLIFIER 
C  =  6  pF  Cg_0  =  1  pF  V+  =  7.5V  V-  =  -7.5V 


Phase  Margin 

45° 

Gain  Margin 

-12  dB 

Settling  Time  (1.0)5) 

2  n  sec 

5  V  Input  Step 

CL  =  5  PF 

Slewing  Rates 

+  10  V/fx  sec 

Unity  Gain  Frequency 

2  MHz 
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H.  DIGITAL  SHIFT  REGISTER 

Figure  19  illustrates  the  digital  shift  register  which  stores 
and  shifts  the  sign  of  each  data  sample  in  synchronism  with  its 
corresponding  analog  data  sample  in  the  CCD  Analog  Delay  Line. 

The  CMOS  shift  register  is  a  dynamic  shift  register  with  a  2  <f) , 
non-overlapping,  clocking  scheme.  The  shift  register  is  a  serial- 
in/parallel-out  (SI/PO)  organization  with  the  parallel  output 
accomplished  in  a  non-destructive  manner.  The  parallel  output 
represents  the  delayed  data  samples,  x  ,  ,  required  in  the  binary 
multiplication  of  the  Exclusive  OR  circuit.  Circuit  operation  is 
shown  in  figure  20. 


HO  U4b8  v  B 


Figure  19a.  Digital  Shift  Register 
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Figure  19b.  Photomicrograph  of  Digital  Shift  Register  Stage 
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Figure  20.  Shift  Register  Operation 
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I.  EXCLUSIVE  OR  CIRCUIT 

The  Exclusive  OR  Circuit,  illustrated  in  figure  21a,  forms 


the  binary  multiplication  product, 

sgn<xm_k)©sgn(em)  =  sgn  (xm_k)  sgn  (ej 

+  s9n(xm-ky  sgn  (em}  (15) 

=  1  sgn(xm_k)  ft  sgn  (ej 
=  0  sgn(xm_k)  =  sgn  (em) 


Figure  21a.  Exclusive  OR  Circuit 

A  "1"  state  produces  a  weight  increment,  while  a  "0"  state  pro¬ 
duces  a  weight  decrement.  A  photomicrograph  of  the  Exclusive  OR 
stage  is  illustrated  in  figure  21b  and  the  operation  of  the  cir¬ 
cuit  is  shown  in  figure  22. 

J.  LEVEL  SHIFTER  CIRCUIT 

The  0  to  +7.5  V  output  of  the  Exclusive  OR  Circuit  is  level- 
shifted  to  a  -7.5  V  to  +7.5  V  output  such  that  the  steering  net¬ 
work,  a  "double-pole/double-throw"  switch,  may  be  operated  in  a 
manner  to  accept  analog  signals  which  varv  around  ground. 
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The  circuit  which  accomplishes  this  function  is  a  cross-coupled, 
flip-flop  and  is  illustrated  in  figure  23a.  This  circuit  performs 
the  level-shifting  function  with  the  address  of  the  PMOS  Transis¬ 
tors.  The  operation  requires  the  proper  ratioing  of  (W/L)  / (W/L) n , 
which  is  typically  15/1  to  ensure  regenerative  action  occurs.  A 
photomicrograph  of  the  level-shifter  is  shown  in  figure  23b. 


v* 


v  80  0468  V  1  1 


Figure  23a.  Level  Shifter  Circuit 
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Figure  23b.  Photomicrograph  of  Level  Shifter 
K.  STEERING  NETWORK 

The  steering  network  acts  as  a  "double-pole/double- throw" 

switch  to  apply  the  appropriate  signals  to  the  bidirectional 

3 

charge-control  (BC  ) .  A  schematic  of  the  steering  network  is 
illustrated  in  figure  24a  while  a  photomicrograph  is  shown  in 
figure  24b.  The  input  signals  to  the  steering  network  are  IG^ 
and  2fj.eQ,  where  the  former  is  a  digital  signal  with  a  15  V  excur¬ 
sion,  and  the  latter  is  an  analog  signal.  From  figure  24a,  the 
output  signals  P<£„ ^  and  P are  controlled  with  the  level  shifter 
outputs  as  follows: 


P«G1 

=  2MeQ 

for 

C' 

=  +V 

=  JG 

P 

for 

C' 

=  -V 

P*r3 

=  IG 

P 

for 

C' 

=  +v 

=  2fieQ 

for 

C' 

=  -V 
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Figure  24a.  Steering  Network 
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Figure  24b.  Photomicrograph  of  Steering  Network 
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L  BIDIRECTIONAL  CHARGE  CONTROL  CIRCUIT 

The  bidirectional  charge  control  circuit  (BC^) ,  illustrated 
in  figure  25  along  with  the  MOS  transistor  weights,  changes  the 
value  of  the  programmable  analog  conductance  at  the  respective 
tap  location.  The  circuit  u  's  the  principal  of  stabilized  charg 
injection  to  perform  the  weight  change.  The  signals  designated 

and  ate  derived  from  the  output  of  the  steering  network 

The  BC'*  performs  both  an  increment  and  decrement  operation  as  de¬ 
termined  by  the  output  of  the  Exclusive  OR  Circuit  at  each  tap 
location . 

3 

Figure  26  illustrates  a  cross-section  of  the  BC  ,  the  poten¬ 
tial  profiles,  and  the  required  timing  to  increment  the  conduct¬ 
ance  (weight)  of  the  MOS  multiplier.  To  increment  a  tap  weight 
requires  6  distinct  time  intervals.  The  function  of  each  time 
interval  is  as  follows: 


1.  PL,in  pulses  to  substrate,  filling  the  potential  wells 
under  electrodes  1  and  2  with  minority  carriers. 

2.  P$M  is  pulsed  to  ground  and  the  charge  on  the  gate  of 
the  MOS  transistor  weight  becomes  shared  between  the 
potential  wells  under  electrodes  4  and  5. 


1.  PD.  pulses  to  V-  (-7.5  volts)  causing  the  PD.  elec- 
in  r  m 

trode  to  become  a  drain  for  the  excess  minority  carrier 
charge  under  electrodes  1  and  2.  The  charge  remaining 
under  electrode  2  after  stabilization  is  given  by: 


where 


K 


2. 


=  signal  charge  to  be  injected  into  CCD 
=  effective  capacitance  of  electrode  2 
=  voltage  on  electrode  1  during  the  stabilization 
period 
=  0  volts 

m  |  =  voltage  on  electrode  2  during  the  stabilization 

period 

P$M  pulses  to  -7.5  volts  resulting  in  a  further  charge 
redistribution  between  the  potential  wells  under  elec¬ 
trodes  4  and  5. 


2. 


P0 


G3 ' 


the  injection  gate  signal,  pulses  to  -7.5  volts 


causing  the  charge  initially  shared  between  electrodes 
4  and  5  to  become  shared  between  electrodes  3,  4,  and  5, 
The  signal  charge  under  electrode  2  is  added  to  the 
charge  under  electrodes  3,  4,  and  5. 


t  =  t,.  : 

_ 4_ 

1.  Electrodes  1  and  2  are  pulsed  to  substrate,  isolating  the 
PD^n  electrode  from  the  injection  gate  electrode. 


1.  Electrode  3  (injection  gate)  is  pulsed  to  substrate, 

forcing  all  charge  to  be  shared  between  electrodes  4  and 

5. 


1.  P^M  pulses  to  substrate,  forcing  all  charge  (original 
charge  plus  increment)  onto  the  capacitance  associated 
with  the  gate  electrode  of  the  MOS  transistor  weight. 

Figure  27  illustrates  a  cross  section  of  the  electrode  con¬ 
figuration,  potential  profiles,  and  the  required  timing  to  decre¬ 
ment  the  conductance  of  the  MOS  transistor  weight.  The  weight 
decrement  configuration  is  achieved  by  using  the  weight  increment 
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Bidirectional  Charge  Control  Circuit  (BC  )  Weight  Decrement 


configuration  and  interchanging  the  signals  on  electrodes  1  and  3. 
The  electrode  signal  interchange  is  performed  by  the  steering  net¬ 
work. 


The  weight  decrement  operation  also  requires  six  distinct 
timing  intervals.  Referring  to  figure  27,  the  operation  of  the 
BC^  in  the  decrement  cycle  is  as  follows: 


1.  P</>M  pulses  to  ground  and  causes  the  charge,  initially 

stored  on  the  capacitance  associated  with  the  gate  elec¬ 
trode  of  the  MOS  transistor  weights,  to  be  shared  between 
electrode  5,  4  (nominally  at  ground  potential),  and  2, 
which  is  below  ground  potential  by  K  |em|- 


1.  F</>m  pulses  to  -7.5  volts,  causing  electrode  4  to  act  as 

a  drain  for  the  excess  charge  under  electrodes  2,  3,  4, 
and  5.  A  quantity  of  charge  given  by 


is  removed  from  the  initial  gate  charge  of  the  MOS  tran¬ 
sistor  weight. 


1.  The  injection  gate  pulse  in  electrode  1  is  enabled  and 
the  charge  under  electrode  2  is  injected  into  the  input 
diode  at  a  potential  of  -7.5  volts. 


1.  Electrodes  1,  2,  and  3  are  pulsed  to  substrate,  which 

isolates  the  gate  of  the  MOS  weight  from  the  input  diode. 


I  V 

1.  P0M  is  pulsed  to  substrate  and  all  remaining  charge  is 

injected  onto  the  capacitance  associated  with  the  gate  of 
the  MOS  weight. 


Figure  25b  is  a  photomicrograph  of  the  BC  circuit  and  MOS  weights 
while  figure  28  shows  operation  of  the  circuit  as  an  integrator. 

With  the  weight  change  by  the  BC^  discussed,  the  final  param¬ 
eter  which  enters  into  the  "clipped  data"  LMS  algorithm 

Wk(m  +  1)  =  Wk(m)  +  2//  •  sgn  xk  •  s an  (  (n)  •  |  f  (IPi)| 

is  determination  of  the  convergence  factor  ^ .  For  the  values  of 
the  resistors  used  on  the  chip,  the  size  of  the  MOS  weight  tran- 

3 

sistors,  and  electrode  capacitance  of  the  BC  ,  //is  given  by  (see 
Appendix  A) 

//  =  4.68  x  10"5  Rext 


Figure  28.  Bidirectional  Charge  Control  Circuit  Operation 
as  a  Dual-Slope  Integrator 


CHIP  TIMING  AND  CLOCK  GENERATION  CIRCUITRY 

Figure  29  illustrates  the  digital  waveforms  required  to  clock 
the  circuits  on  the  adaptive  filter  chip.  The  thirteen  waveforms 
can  be  divided  into  3  groups:  one  group  to  clock  the  CCD,  a  sec¬ 
ond  group  to  control  the  analog  signal  processor  and  digital  shift 


register,  and  a  third  group  to  clock  the  bidirectional  charge  con¬ 
trol  circuits.  The  CCD  timing  and  clamp/sample  cycle  are  designed 
to  maximize  the  time  available  for  weight  update  in  order  to  mini¬ 
mize  the  constraints  on  the  operational  amplifiers.  In  addition, 
the  timing  is  designed  to  minimize  the  complexity  of  the  combina¬ 
torial  logic  timing  generator  circuitry. 

Figure  30  shows  the  timing  waveforms  as  obtained  from  the 
chip.  Considerable  loading  effects  are  due  to  probing  with  a 
high  capacitance  probe.  All  waveforms  are  correct  except  for 
P^r-IH  has  been  corrected  by  a  mask  change. 

A  schematic  of  the  timing  generator  is  shown  in  figure  31 . 

The  input  clock  is  counted  down  by  3  D-type  flip-flops.  Outputs 
are  taken  from  the  master  (M,  M)  and  slave  (Q,  Q)  of  each  flip- 
flop  and  are  used  in  conjunction  with  nand-gate  combinatorial 
logic  to  generate  the  required  waveforms.  All  the  combinatorial 
logic  functions  are  performed  at  low  logic  levels  (0  to  +7.5  V) 
and  translated  to  high  logic  levels  (-7.5  V  to  +7.5  V)  by  level 
shifters  to  reduce  power  dissipation.  ISPICE  simulations  were 
used  to  size  the  devices  to  achieve  100  nsec  rise  and  fall  times 
on  all  clock  waveforms. 


3-4*4 


3-45 


Timing  Diagr 


FEATURES  OF  THE  MONOLITHIC  ADAPTIVE  FILTER 


Figure  32  shows  a  complete  schematic  of  the  adaptive  filter 
and  several  features  are  included  which  have  not  been  discussed. 
The  first  feature  is  the  ability  to  externally  program  the  tap 
weights.  External  programming  is  enabled  by  bringing  the  voltage 
designated  VM  to  +7.5  volts  and  VWR  to  -7.5  volts.  This  action 
disables  sgn  xm  from  entering  the  digital  shift  register  and 
enables  the  weight  commutation  transistor,  respectively.  An  ex¬ 
ternal  strobe  pulse,  SRj,  is  entered  into  the  shift  register  and 
the  external  analog  weight,  wEXt'  is  transmitted  onto  the  gate  of 
the  MOS  transistor  weight  when  the  shift  register  pulse  enables 
the  respective  p-channel  commutation  transistor  via  the  steering 
network.  The  external  update  mode  automatically  disables  the  BC° 

output  at  each  tap  location.  As  the  weight  update  is  sequential 

* 

in  the  external  mode,  a  lower  limit  is  placed  on  the  shift  regis¬ 
ter  scan  rate  and  weight  refresh  time  due  to  the  retention  time 
of  the  charge  on  the  gate  of  the  MOS  transistor  weight. 

The  second  feature  included  on  the  adaptive  filter  chip  is  the 
ability  to  interrogate  or  read  out  the  weight  values.  With  VR7R 
and  V{1  at  +7.5  volts,  impulsing  the  CCD  will  produce  an  output 
response,  y  ,  which  is  a  linear  function  of  the  weight  value  at 
each  tap  location.  These  weight  values  can  then  be  stored,  if 
desired,  and  reprogrammed  via  the  technique  just  discussed  to 
form  a  filter  with  a  fixed  impulse  response. 

An  additional  feature  is  the  ability  to  use  the  error  derived 
internally  via 

(  =  d  Y 

m  m-  m 

or  have  the  error  derived  externally  from  a  process,  for  instance, 
not  explicitly  connected  with  the  reference  input.  Shorting  the 
two  bonding  pads  labelled  (cas)  causes  the  internally  generated 
error  to  be  used. 
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An  additional  tap  called  the  "bias  tap"  is  included  on  the 
chip  to  compensate  for  slow  variations  in  the  dc  level  of  the  de¬ 
sired  input  signal.  Finally,  the  adaptive  filter  chip  is  de¬ 
signed  such  that  chips  can  be  cascaded  to  form  adaptive  filters 
requiring  a  larger  number  of  taps. 
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IV.  FABRICATION  TECHNOLOGY 


The  CCD  Adaptive  Signal  Processor  is  fabricated  with  an  ion- 
implanted,  double  polysilicon,  CMOS  technology.  Figure  33  illus¬ 
trates  the  process  sequence  employed  in  the  fabrication  of  the 
Adaptive  Filter  chip.  There  are  basically  10  photosteps  includ¬ 
ing  protective  silox  overcoat  for  the  bonding  pads.  A  cross- 
section  of  the  CCD  Adaptive  Filter  is  illustrated  in  figure  34. 

The  first  ion-implantation  is  used  to  define  the  p~  well  for  the 
NMOS  Transistors,  while  the  second  ion-implantation  determines 
the  sheet  resistance  of  the  resistors  for  the  CMOS  Operational 
Amplifiers.  The  basic  gate  insulator  is  a  dual  dielectric  con- 

°  O 

sistmg  of  800  A  Si02  covered  with  500  A  of  Si^N^.  The  gate 
electrodes  are  phosphorous-doped ,  polysilicon  and  the  CCD  is  a 
double  polysilicon,  coplanar,  electrode  geometry.  Several  unique 
features  of  this  desiqn  are  the  ion- implanted  resistors,  the  field 
shield  to  prevent  field  inversion,  and  the  double  polysilicon 
capacitor  which  is  used  for  the  compensation  and  clamp/sample 
capacitors.  An  important  step  in  the  overall  process  is  the 
so-called  "back-side"  .sc  ter  t  <  sink  the  dislocations  and  provide 
excellent  bulk  lifet  imos. .  iM •  •  I  illustrates  some  of  the  pro¬ 
cess  parameters  ulita  i  •:  (VP  CMOS  Technology. 

The  surface  ncom!  o  .  •  •  1  -  - 1 1  y  is  minimized  with  a  H2 

anneal  after  tin-  1  ••  w .  •  w  u «  >;>«-ned  in  step  (34).  The 

sheet  rc'sistanc'-  c  1  .  e  •  jo;  ,  is  illustrated  in  f igure 

35  and  the  nominal  ">i  ..  1 .  •  • :  ,  *  :  recess  is  1 000  Q  /square  for 

an  ion-implant.. it  i<  r  •  *  .  >:  1  ’  1  >i.r  •m‘  at  p  HO  KeV  (Boron)  . 

The  linearity  and  stab:  i  it'.  :  •  1  ■  ■■- i  mp  1  ant  ed  Boron  resistors 

is  excellent  .  Typical  C-V  Car  irti  1  iP  irs  for  the  CMOS  process 
are  illustrated  in  f  inure  P  u.d  tin  I-V  charaet  eristics  of  minimum 
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TABLE  7 

(CCD/CMOS  PROCESS  PARAMETERS) 

Threshold  Voltage 

P-channel  MOSFET 

-1 . 6  to  -2 . 1  V 

N-channel  MOSFET 

0.8  to  +1.6  V 

Breakdown 

P+  to  N 

45  V 

N+  to  P" 

24  V 

P-  to  N 

250  V 

Substrate  NPN  Bipolar  Transistor 

0  (Ic  =  1  mA) 

100  -  150 

BV  . 

60  V 

CEO 

Minority  Carrier  Generation- 

Recombination  Lifetimes  (C-t) 

100  fji. sec 

Voltages  for  7012  CMOS  Process 


geometry  PMOS  and  NMOS  Transistors  are  shown  in  figure  37.  Figure 
38  illustrates  the  I-V  characteristics  of  the  Substrate  NPN 
Bipolar  Transistor,  which  is  used  in  the  CMOS  Operational  Ampli¬ 
fiers  and  the  FCES  circuit  at  each  tap  position  of  the  CCD  analog 
delay  line.  Figure  39  illustrates  a  C-V  characteristic  of  a 
PMOS  capacitor  and  a  C-t  curve  which  illustrates  a  high  bulk 
lifetime  in  excess  of  350  fx.se  c .  This  is  due  to  the  excellent 
bulk  gettering  with  phosphorous  and  the  front-surface  anneal  with 
hydrogen.  The  leakage  current  for  the  CMOS  process  is  typically 
10  nA/cm^. 


Figure 


3  /a . 


I-V  Characteristic  of  X-Channel  MOSFET 
(Low  Vo It ace) 


Measurement  of  Lifetime 


The  electrode  structure  of  the  CCD  is  an  overlapping,  dual 
polysilicon,  co-planar,  geometry  as  illustrated  in  the  cross- 
section  of  figure  34.  A  Scanning  Electron  Microscope  (SEM)  view 
of  the  CCD  structure  is  illustrated  in  figure  40(a)  and  40(b) 
with  the  low-temperature  silox  overcoat  and  insulating  thermal 
oxide  between  the  two  polysilicon  layers  clearly  visible.  The 
2  jtm  overlap  of  the  polysilicon  electrodes  is  visible  in  figure 
40(b),  which  was  taken  of  a  cross-section  of  the  CCD  analog  shift 
register . 
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Figure  40a.  Top  View  of  CCD  Analog  Shift  Register 
(Delay  Line)  With  Electrode  Length  =  7  fim 
and  Width  =  1  2 5  /xm 
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Figure  40b.  Side  View  of  CCD  Analog  Delay  Line  With 
Coplanar  Overlapping  Polysilicon  Electrodes 
(Overlap  =  2  /im) 

A  Cal-Comp  plot  of  the  CCD  Adaptive  Signal  Processor  is 
illustrated  in  figure  41.  Bonding  pads  are  strategically  placed 
on  the  chip  to  evaluate  intermediate  operating  points.  The  wave¬ 
forms  obtained  on  the  various  component  sections  of  the  CCD 
Adaptive  Signal  Processor  and  discussed  in  Section  III,  were  ob¬ 
tained  by  either  probing  or  bonding  to  these  pads.  For  example, 
the  CCD  Analog  Delay  Line  waveforms  were  obtained  by  examination 
of  the  tapped  outputs  as  indicated  in  the  center  of  figure  41. 

The  organization  of  the  chip  is  illustrated  in  figure  42.  The 
digital  clocking  and  waveform  generation  circuitry  is  located  on 
the  left  side  of  the  chip,  whereas,  all  analog  signal  processing 
is  maintained  on  the  right  side  of  the  chip  to  minimize  inter¬ 
action.  A  more  detailed  descripti-on  of  the  chip  can  be  found  in 
Section  III  and  figure  £  which  illustrates  a  complete  schematic 
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Figure  41.  Cal-Comp  Plot  of  the  CCD  Adaptive  Signal 
Processor  Integrated  Circuit 
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Figure  42.  CCD  Adaptive  Signal  Processor  Chip  Organization 
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of  the  functional  operation.  Figure  4  3  is  a  photomicrograph  of 
the  completed  CCD  Adaptive  S i cm  1  Processor  Integrated  Circuit 
which  is  a  180  mil  x  210  nil  die  size.  The  total  powei  dis¬ 
sipation  of  the  chip  is  approximately  250  mlv  and  the  frequency 
response  limitation  (i.e.,  sampling  clock  frequency  of  the  CCD) 
is  set  by  the  bandwidth  of  the  Operational  Amplifiers  which  deter¬ 
mines  the  settling  time  accuracy  in  the  analog  signal  processor. 
Maximum  CCD  clocking  frequency  is  about  100  kHz  while  minimum 
clocking  frequency,  set  by  thermal  leakage  considerations,  is 
approximately  1  kHz. 


Figure  11.  CCD  Adaptive  Signal  Processor  Photomicrograph 
Chip  Size  180  Mils  x  220  'Mils 
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V.  APPLICATIONS 


There  are  a  number  of  applications  for  adaptive  filters  with 
special  need  for  real-time  signal  processing.  Several  applications 
are : 

•  Estimation/Predication 

•  Filtering 

•  Spectral  Analysis 

•  Data  Compression 

•  Interpolation 

•  Multiple  Linear  Regression 
ADAPTIVE  NOISE  CANCELLATION 

A  very  important  application  area  is  adaptive  noise  cancelling 
such  as  the  removal  of  interference  in  electrocardiography,  noise 
in  speech  signals,  clutter  cancellation  in  antenna  (or  similar 
type  systems  with  hydrophones,  seismic/acoustic  transducers, 
electro-optical  sensors,  etc.)  sidelobe  interference,  and  coherent 
signal  processing  when  periodic  signals  must  be  separated  from 
broadband  interference  such  as  spread-spectrum  systems.  Figure 

44  illustrates  the  application  of  adaptive  noise  cancelling  to 
electrocardiography,  such  as  cancellation  of  60  Hz  interference 
in  conventional  ECG,  the  donor  ECG  in  heart  transplants,  and  the 
material  ECG  in  fetal  electrocardiography.  The  advantage  of  this 
technique  is  the  cancellation  of  the  interference  even  when  the 
latter  drifts,  since  the  reference  input  to  the  filter  will  also 
drift.  An  example  of  this  application  is  illustrated  in  figure 

45  which  indicates  the  operation  of  the  CCD  Adaptive  Filter  before 
and  after  adaptation. 


•  Echo  Cancellation 

•  Speech  Analysis 

•  Noise  Cancellation 

•  Coherent  Signal  Processing 

•  Frequency  Measurement 

•  System  Modeling 
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A  second  area  is  the  cancellation  of  noise  in  speech  signals 
such  as  the  situation  which  arises  in  pilot  communications  with 
a  high  level  of  background  engine  noise.  This  interference  con¬ 
tains  strong  periodic  components  in  the  speech  frequency  band  and 
the  intelligibility  of  the  radio  transmission  is  affected.  A 
conventional  filter  would  not  be  sufficient  since  the  frequency 
and  intensity  of  these  interference  signals  vary  with  engine 
speed  and  load,  in  addition  to  the  location  of  the  pilots  head. 
Figure  46  illustrates  the  cancellation  of  noise  in  this  particular 
example.  A  reference  input  is  obtained  by  placing  a  second  micro¬ 
phone  at  a  suitable  location  in  the  pilot's  cabin.  Experiments 
have  performed1  to  illustrate  the  concept  of  noise  cancellation 
with  strong  acoustial  interference  in  speech  transmission.  The 
interference  consisted  of  an  audio  frequency  triangular  wave  that 
contained  many  harmonics  which  varied  in  amplitude  and  phase  be¬ 
cause  of  the  multipath  scattering  effects  throughout  the  room. 
Typically,  16  analog  weights  "rendered  the  interference  barely 
perceptible  to  the  remote  listener. 


K*>C  raphor'e 
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Figure  46.  Cancellation  of  Noise  in  Speech  Communication 


B.  Widrow,  et.  al . ,  "Adaptive  Noise  Cancelling:  Principles  and 
Applications"  Proc.  IEEE  63,  1692  (1975). 
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A  third  area  of  noise  cancelling  is  in  adaptive  cancellation 


of  sidelobe  interference  in  receiving  arrays.  For  example,  a 
sensor  beamformer  may  be  constrained  with  the  adaptive  noise 
canceller  as  shown  in  figure  47.  The  reference  input  to  the 
noise  canceller  is  obtained  from  the  "organ-pipe"  beam-former 
array  after  summation.  Figure  48  illustrates  photomicrographs  of 
16  and  69  input  "organ-pipe"  geometries2  which  buried  channel 
CCD  technology  and  on-chip,  support  circuits  to  reconstruct  one 
sample-data  signals. 

0  lAHOt  > 


Figure  47.  An  Adaptive  Beamformer  Array  to  Remove 
Jammer  Interference 


1 


B.  Widrow,  et.  al.,  "Adaptive  Noise  Cancelling:  Principles  and 
Applications"  Proc.  IEEE  63,  1692  (1975) 

K.J.  Petrosky  and  M.H.  White,"  CCD  Sonar  Beam-Forming".  Proceed¬ 
ings  of  1978  Conference  on  CCD  Applications,  San  Diego,  California. 
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a)  16-Element  Beamformer  b)  64-Element  Beamformer 

Figure  48.  Photomicrograph  of  CCD  Beamformer  Devices 

A  fourth  area  of  interest  is  the  separation  of  broadband  and 
periodic  signals  as  illustrated  in  figure  49.  The  insertion  of 
a  fixed  delay  in  the  reference  path,  as  shown  in  figure  49a  de¬ 
correlates  the  broadband  components  and  the  narrow-band  components 
remain  correlated.  This  is  an  excellent  method  in  the  case  when 
no  external  reference  input  is  available  such  as  speech  or  music 
playback  in  the  presence  of  tape  hum  or  turntable  rumble.  Another 
area  of  application  is  in  spread-spectrum  communication  with 
narrow-band  jamming.  Figure  49b  illustrates  the  recovery  of  the 
periodic  components  with  applications  to  automatic  signal  seeking 
and  the  enhancement  of  low  level  sinusoidal  signals  buried  in 
broadband  noise.  Thus,  the  adaptive  filter  functions  as  a 
coherent  signal  processor.  An  important  application  area  is  the 
use  of  the  CCD  Adaptive  Signal  Processor  as  a  Maximum- Entropy 
Method  (MEM)  for  a  pre-whitening,  clutter  cancellation  filter  in 
Radar  and  Sonar  Doppler  Signal  Processing. 
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a)  Cancellation  of  Periodic  Interference  with 
Adaptive  Noise  Canceller 


b)  Self-Tuned  Filter 
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Figure  49.  Separation  of  Broadband  and  Periodic  Signals 
as  in  Spread  Spectrum  Systems 

ADAPTIVE  LINEAR  PREDICTION  FOR  NARROWBAND  SPEECH/VOICE  PROCESSING 
A  promising  area  for  CCD  adaptive  filtering  is  in  speech  pro¬ 
cessing  where  redundancy  in  the  spoken  word  has  long  been  re¬ 
cognized  by  researchers.  Electrical  processing  of  speech  which 
takes  into  account  this  redundancy  can  be  used  to  substantially 
reduce  the  bandwidth  required  for  speech  transmission.  For  ex¬ 
ample,  if  speech  is  sampled  and  quantized  at  56  k  bits/sec  (7  bits 
or  128  possible  amplitude  levels  per  sample  at  8  k  samples/sec) 
for  acceptable  fidelity  and  the  channel  bandwidth  restricts  trans¬ 
mission  to  below  4  k  bits/sec,  then  a  speech  compression  ratio  of 
approximately  15:1  is  attempted.  This  low  data  rate  would  permit 
speech  to  be  transmitted  over  high  frequency  radio  or  telephone 
links  which  have  bandwidths  barely  wide  enough  for  the  original 
analog  speech  sounds.  Such  a  narrow-band  voice  digitizer  may  be 
used  in  frequency  division  multiplexing  for  simultaneous  trans¬ 
mission  over  wide-band  channels.  Narrow-band  digitized  speech 
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lends  itself  to  encryption  for  secure  communications  and  provides 
a  better  S/N  then  a  wide-band  digitizer  particularly  in  RF  trans¬ 
mission  communication  sattelite  links  with  limited  or  fixed  avail¬ 
able  power. 

"Speech  compression,  which  maintains  intelligibility,  has 
always  been  difficult  because  speech  consists  of  more  than  words 
and  messages.  Speech  has  the  vocal  timbre  and  conversational 
idiosyncrosies  of  the  speaker  and  the  emotion  behind  his  words. 

It  is  normally  constructed  in  an  imprompt  manner  and  delivered  in 
a  free  and  informal  fashion.  Speech  flows  in  time  as  a  continua¬ 
tion  that  a  voice  digitizer  must  process  in  real  time,  leaving 
no  chance  for  later  evaluation  or  correction.  Although  the  infor¬ 
mation  content  of  the  message  itself  may  be  low,  (possibly  below 
100  bits/sec),  transmission  of  the  subtle  vocal  inflections  re¬ 
quires  a  date  rate  of  several  thousand  bits/sec.  "•*  Historically, 
speech  compression  and  reconstruction  began  with  the  Dudley  chan¬ 
nel  vocoder  in  1936  in  which  the  Fourier  Spectrum  characteristics 
of  speech  determined  the  parameters  of  a  filter  bank.  This  vocal 
tract  filter  bank  approximated  the  vocal  tract  resonance  character¬ 
istics  of  speech  and  it  was  excited  by  a  pulse  generator  (variable 
period)  to  approximate  the  vowels  or  larynx  vibration  and  a  random 
noise  generator  to  represent  the  consonants  or  fricative  nasal 
sounds. 

Another  technique  has  proven  quite  successful  in  speech  com¬ 
pression:  linear  predictive  analysis.1*  The  Fourier  analysis 

method  treats  the  past  signal,  and  the  linear  predictive  analysis 
method  attempts  to  predict  the  future  signal.  Linear  prediction 
uses  time  domain  characteristics  of  the  speech  signal  and  the 
voice  signal  is  analyzed  as  a  linear  combination  of  present  and 
past  values  to  form  a  set  of  prediction  coefficients.  If  10  to  12 

j- 

G.S.  Kang,  "Linear  Productive  Narrowband  Voice  Digitizer" 

EASCON  74,  51,  Washington,  D.C.  Oct.  7-9,  1974. 

4 

B.S.  Atal  and  S.L.  Hanauer.  "Speech  Analysis  and  Synthesis  by 
Linear  Prediction  of  the  Speech  Wave",  J.  of  Acoust.  Soc.  Amer., 
50,  637  (1971). 
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consecutive  samples  of  speech  are  taken  (i.e.,  a  speech  segment 
of  1.25  to  1.5  milliseconds),  then  prediction  coefficients  can  be 
generated  as  the  tap  weights  in  an  adaptive  filter.  Although 
only  10  to  12  prediction  coefficients  are  needed,  one  must  accumu 
late  many  speech  samples  (e.g.,  100  to  200  samples)  to  determine 
these  coefficients  with  some  degree  of  accuracy.  The  accuracy  of 
these  measurements  was  discussed  by  Gauss,  with  regards  to  highly 
redundant  or  over-determined  equations ,  and  he  f ormulated  the 
method  of  least-squares.  This  method  is  used  in  the  CCD  adaptive 
filter. 

Figure  50  illustrates  a  functional  diagram  of  a  conventional 
digital  linear  productive  narrowband  voice  processor.  The  major 
functional  elements  of  this  system  are 

•  vocal  tract  analyzer  •  encoder/decoder 

•  pitch  extractor  •  synthesizer 

•  voice/unvoice  analyzer 
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Figure  50.  Narrowband  Voice  System 


Digital  systems  which  use  linear  prediction  have  been  analyzed 

c  g 

and  built,  however,  the  major  limitations  to  an  all  digital 
approach  are  size,  power  dissipation,  and  cost.  Table  8  illus¬ 
trates  a  comparison  between  the  digital,  hybrid,  and  discrete 
analog  sampled  approaches  for  a  narrow-band  voice  system. 

Figure  51  illustrates  the  use  of  the  CCD  Adaptive  filter  as 
an  Analysis  filter  to  generate  the  prediction  coefficients 
W.j . . .  .  The  voice  input  is  band-pass  filtered  and  inputted  to 

the  adaptive  filter.  The  filter  input  is  also  used  as  the  primary 
or  desired  signal  to  generate  an  error  called  the  prediction 
residual.  This  error  may  be  further  messaged  to  extract  the 
pitch  period,  amplitude,  and  voice/unvoice  decision.  The  speech 
sample  may  be  nominally  20  msec  in  length  and  the  error  must  con¬ 
verge  to  its  minimum  value  in  this  time  frame.  Near  the  end  of 
the  time  frame,  a  unit  pulse  is  inserted  into  the  filter  and  the 
filter  output  becomes  the  converged  weights  or  prediction  coef¬ 
ficients.  The  clipped  data  LMS  algorithm  has  been  computer/ 

7 

simulated  at  NRL  with  the  following  constraints, 

•  preemphasis  filter  on  the  input  signal 

•  Wk  <  0. 98 

•  an  increase  of  the  unit  circle  (Z-domain)  by  10  percent 
with  scaling  of  the  prediction  coefficients 

•  10  prediction  coefficients  of  bit  levels:  8 , 8 , 8 , 8 , 7 , 7 , 7 , 6 , 5, 5 

•  data  rate  of  3600  bits/sec. 

The  prediction  coefficients  generated  with  the  clipped  data  LMS 
algorithm  and  the  above  constraints  were  used  to  synthesize  speech. 
Test  sentences  were  employed  and  the  playback  of  the  reconstructed 
speech  indicated  good  speech  reproduction  and  quality,  although  the 

^J. E.  Dunn,  J.R.  Lowan  and  A.J.  Russo,  "Progress  in  The  Development 
of  a  Digital  Vocoder  Employing  on  Itakura  Adaptive  Predictor"  (1973) 

6Final  Report,  Voice  Processor  LSI/Organization  Optimitation  Study, 
Contract  No.  DCA  1 OO-75-C-bbSO ,  Sept.  1975  TRW  Systems  Group, 

Redundo  Beach,  Cal. 

7G.S.  Kang,  Private  Communication,  Naval  Research  Laboratories 
(1977)  “  ' 


TABLE  8 


NARROWBAND  VOICE  DIGITIZER 


#  of 

I.  C.  's 

Power 

Size 

Prod. 

Cost 

Risk 

Digital 

125 

50w 

3"x5"xl2" 

10k 

Low 

Hybrid 

40 

- 

3"x5"x6" 

- 

Med 

DASP 

12 

7w 

I"x5"x5" 

0.  5- lk 

High 
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latter  is  a  subjective  parameter.  Thus,  a  CCD  adaptive  filter 
with  10  weights  operating  at  a  8  kHz  xample  rate  is  an  excellent 
candidate  for  this  particular  application. 

Robust  Linear  predictive  coding  (LPC)  Systems  required  a 
"prewhitening"  type  filler  preceding  the  analyzer  to  remove 
strong  narrow-band  interference.  The  CCD  Adaptive  Signal  Pro¬ 
cessor  may  be  used  as  (1)  a  front-end  noise-canceller  preceding 
the  (2)  analyzer  portion  of  the  LPC  system. 

ADAPTIVE  ECHO  CANCELLATION  FILTERS 

An  important  application  of  CCD  adaptive  transversal  filters 
is  in  echo  cancellation  in  the  telephone  network.®  Weinstein  says 
"It  is,  to  be  honest,  remarkable  that  a  technique  (echo  cancella¬ 
tion)  which  has  been  studied,  favorably  appraised,  and  implemented 

S - ; - 

S.B.  Weinstein,  "Echo  Cancellation  in  the  Telephone  Network", 

IEEE  Communications  Society  Magazine,  pg.  9,  Jan.  1977. 


Analysis  Filter  -  Digital  Implementation 


in  experimental  hardware  for  more  than  10  years  has  still  not  been 
commercially  applied.  The  obvious  reason  is  that  echo  cancellers 
which  performs  better  than  echo  suppressors  have  tended  to  cost 
much  more  than  echo  suppressors,  it  is  intrinsically  more  diffi¬ 
cult  to  discover  and  separate  an  echo  from  a  mixture  of  signals 
than  to  block  everything."  CCD  adaptive  filters  offer  a  means  to 
realize  such  an  echo  canceller. 

The  study  of  echos  in  the  telephone  network  has  shown  that  it 
is  difficult  to  conduct  a  conversation  when  a  person’s  voice  re¬ 
turns  with  a  delay  greater  than  a  few  tens  of  milliseconds.  The 
long-delayed  echos  are  irritating  and  returns  attenuated  -40  dB 
below  the  speakers  voice  level  will  cause  the  speaker  problems. 
Echos  occur  due  to  impedance  mismatches  in  the  communication 
system  as  illustrated  in  figure  52a,  which  describes  signal 
leakage  and  reflection  at  the  hybrid  coupler.  Figure  52b  illu¬ 
strates  how  an  echo  canceller  is  used  to  model  the  echo  channel 
and  generate  an  output  echo  replica  to  cancel  the  echo.  This  is 
particularly  important  in  satellite-routed  circuits  which  experi¬ 
ence  signal  delays  in  excess  of  500  msec.  Digital  echo-canceller 
•  .  9 

chips  have  been  built  to  interface  with  either  an  8-bit ^  -law  or 
A-law  code  for  CODEC  Applications. 

SYSTEM  MODELING 

Perhaps  one  of  the  most  important  future  applications  of  a 
monolithic  adaptive  CCD  adaptive  signal  processor  is  system  model¬ 
ing.  In  this  instance,  an  unknown  system  whose  system  transfer 
function  is  changing  with  time  is  to  be  measured  in  real  time  and 
in  response  to  specific  system  inputs.  Paralleling  the  unknown 
system  with  a  CCD  adaptive  signal  processor,  the  process  of 
minimizing  the  MSE  provides  a  set  of  adaptive  processor  weights 
which  represent  the  impulse  response  (transfer  function)  of  the 
system  to  be  modeled.  Once  the  impulse  response  is  determined. 


9 


D.  J. 


Duttweiler , 


"Bell's  Echo-Killer  Chip"  IEEE  Spectrum,  17, 


34  (1980). 
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a)  Model  of  Long-Distance 

Telephone  Circuit  Which  May 
Include  a  Satellite  l.ink 


B0-007SV-46 

b)  Echo  Cancellation  with  CCD 
Adaptive  filter  to  Model 
Echo  Channel  from  Points  A  to  D 


Figure  52.  Echo  Cancellation  With  CCD  Adaptive  Filters 

the  response  of  the  system  to  another  input  is  known.  In  partic¬ 
ular,  if  a  certain  system  output  response  is  desired,  then  the 
system  input  can  be  adjusted  in  real  time  to  provide  this  output 
response.  Figure  53  illustrates  the  concept  of  system  modeling 
as  applied  to  adaptive  predictive  control.  The  unknown  system  is 
modeled  in  real-time,  while  in  compressed  time  (off-line)  the 
predicted  control  inputs  to  the  system  are  determined  with  the 
CCD  Adaptive  Filter  employed  as  a  linear  predictor.^  The  use  of 
adaptive  predictive  control  (APC)  has  been  the  subject  of  many 
papers  in  the  literature,  particularly,  the  work  of  Richalet.^ 

APC  may  be  applied  in  a  number  of  application  areas  as  illustrated 
in  table  9.  A  particular  area  of  interest  is  in  the  control  of 

^G.  Axelby,  Private  Communication.  Westinghouse  Electric  Corp. 

1 1 

J.  Richalet,  el.  al,  "Model  Predictive  Heuristic  Control: 
Applications  to  Industrial  Processes",  Automatica,  Peraammon 
Press  (1978).  ' - 
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TABLE  9 
APPLICATIONS 


•  Machine  Tool  Systems  • 

•  Robotics  • 

•  Process  Control  • 

•  Electrical  Power  Generation  • 

•  Jet  Engine  Control 


•  Nuciear  Power  Plant  Control 

•  Ignition,  Water/Heat,  and  Exhaust 
Control  in  Automobiles 


Manufacturing  Processes 

Maritime  Controls  For  Ships 

Missile  and  Aircraft 

Waste  Water  Purification  and 
Desalination 

Biological  Control  Systems 
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Figure  53.  System  Modeling  as  Applied  to 
Adaptive  Predictive  Control 


I 

I 

industrial  robots,  where  high  speed  operation  will  be  required  in 
1  2 

the  future.  For  example,  in  the  case  of  an  industrial  robot 
for  machining  functions  there  are  (1)  cutting  depth  and  feed-rate 
controls  required  when  the  grinding  force  varies,  (2)  changes  re¬ 
lating  to  the  location  or  orientation  of  a  part  within  the  robots 
area  of  influence  may  be  controlled  with  tactile  (e.g.,  pressure) 
and  visual  sensors  which  provide  inputs  to  adapt  to  a  changing 
environment.  Table  10  illustrates  the  features  that  APC  can  pro¬ 
vide  for  Industrial  Robotics. 

TABLE  10 

INDUSTRIAL  ROBOTICS 


•  Built-In  Electronic  Intelligence 

•  No  Speed  Change  Gears  or  Belts 

•  No  Brakes  or  Limit  Switches 

•  Rapid  Movement 

•  Accuracy 

•  Repeatability 


12 


"Busy  Robots  Spur  Productivity" 
31-36. 


,,  Sept.  1979,  pg 


VI.  CONCLUSIONS 


For  the  first  time,  an  entire  16-tap  weight  Adaptive  Signal 
Processor,  which  employs  the  "clipped-data"  LMS  Error  Algorithm, 
has  been  implemented  on  a  monolithic  silicon  chip  of  180  mils 
x  220  mils  die  size.  The  inputs  to  the  chip  are  analog  and  the 
processor  uses  discrete  analog  signal  processing  (DASP)  to  achieve 
a  dynamic  range  of  60  dB  in  analog  signal  processing,  a  50-dB 
dynamic  range  in  the  weights,  and  a  maximum  sampling  frequency 
of  100  KHz.  The  organization  of  the  Adaptive  Signal  Processor 
is  a  simultaneous  up-date  of  the  weights  for  each  data  sample 
entry  into  the  processor,  where  the  error  is  determined  on  a 
sample-to-sample  basis.  The  entire  power  dissipation  is 
approximately  200  mW  and  is  determined  by  the  operational 
amplifiers  and  comparators  which  set  the  sampling  rate  by  the 
settling  times  in  the  sampling  circuitry.  The  technology  is 
CMOS  bulk  with  double  polysilicon  electrodes  of  7  /a m  lines  and 
5  /Am  spacings  to  achieve  2-1/2  phase  CCD  (surface  channel) 
operation  with  non-destructive  tapping  of  the  analog  signal 
samples.  The  CMOS  technology  permits  the  realization  of  analog 
operational  amplifiers  (11  mils  x  16  mils)  and  comparators, 
together  with  CMOS  logic,  buffer  I/O's,  and  level  translator- 
drivers  . 

A  comparison  of  the  DASP  approach  for  advanced  adaptive 
signal  processing  with  the  conventional  digital  implementation 
indicates  the  advantages  for  the  former.  The  digital  approach 
would  have  to  achieve  a  minimum  8-bit  resolution  in  signal  and 
tap  weight  dynamic  range  to  be  comparable  to  DASP.  An  analysis 
of  the  digital  implementation  indicates  the  need  for  a  16K 
gate  chip  (gate  =  2-input  NAND  gate)  custom  layout,  minimum 
feature  sizes  of  2  /Am  (i.e.,  2  /Am  lines  and  spacings),  double 
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metal  technology,  and  CMOS  bulk  technology  for  low  standby  power 

dissipation.  In  addition,  2  A/D  converters  and  2  D/A  converters 

would  be  required  to  provide  the  necessary  I/O  capability  of  the 

DASP  implementation  of  the  Adaptive  Signal  Processor.  The  digital 

portion  of  the  processor  (i.e.,  the  16K  gate  chip)  is  in  keeping 

with  the  goals  of  VHSIC,  phase  1,  where  a  functional  throughput 

1 1 

rate  (FTR)  =  5  x  10  is  desired.  In  this  example,  a  16K  gate 

chip  of  250  mils  x  250  mils  die  size,  and  operating  at  a  20  MHz 

clock  rate  (this  rate  is  required  to  access  signal  and  weight 

data  from  RAM  and  to  achieve  the  8x8  digital  multiples  for  a 

11 

nominal  50  KHz  sampling  rate)  would  provide  a  FTR  =  7.8  x  10 
gates-cm  ^Hz  (e.g.,  16K  x  20  MHz/ (0.4  cm^) .  Although  the 
advantages  of  the  digital  approach  are  the  extremely  slow  sampl¬ 
ing  rates  for  control  applications,  and  the  storage  and  retrieval 
of  weight  values  for  system  modeling,  etc.,  the  cost  and  yield 
of  such  a  chip,  exclusive  of  the  power  dissipation  and  A/D  -  D/A 
requirements,  are  certain  to  be  easily  an  order  of  magnitude 
over  the  DASP  approach. 

In  this  preliminary  study  of  the  feasibility  of  DASP  for 
such  an  Adaptive  Signal  Processor  we  concentrated  on  the  system 
architecture  and  technology  which  would  lead  to  a  monolithic 
silicon  chip,  and  would  be  extendible  to  other  architectures 
and  algorithms,  and  permit  the  increase  in  tap  weights  from  an 
initial  value  of  16  to  say,  256.  The  basic  components  of  the 
Adaptive  Signal  Processor  are  the  CCD  Analog  Delay  Line  with 
non-destructive  taps,  a  set  of  adjustable  tap  weights  represented 
by  the  electrically  reprogrammable  analog  conductance  MOSFET's 
and  an  algorithm,  to  control  and  up-date  the  weights.  The 
Adaptive  Signal  Processor  has  been  designed  with  versatility  in 
mind.  Internally  or  externally  generated  errors  may  be  used  to 
adjust  the  tap  weights  at  each  tap  location.  In  addition,  the 
weight  values  may  be  determined  internally  or  programmed  exter¬ 
nally  from  MDAC ' s .  A  feature  exists  to  recycle  the  weights  for 
long  retention.  A  so-called  "bias-tap"  or  17th  tap  is  employed 
to  measure  the  average  level  of  the  incoming  reference  signal 


and  may  be  used  to  compensate  for  input  drift.  A  provision 
exists  for  the  cascading  of  chips  to  achieve  longer  chains  of  tap 
weights.  Finally,  the  control  of  the  convergence  and  accuracy  of 
the  adaptive  signal  processor  is  accomplished  with  an  off-chip 
scaling  network. 

The  basic  functional  components  of  the  Adaptive  Signal 
Processor  chip  have  been  evaluated  as  described  in  this  report. 
Minor  photographic  mask  modifications  have  been  made  to  correct 
the  few  errors  in  circuit  layout  and  selection  of  component 
values.  Additional  processing  and  evaluation  is  planned  to  permit 
the  complete  evaluation  of  the  Adaptive  Signal  Processor.  The 
applications  of  this  type  of  Adaptive  Signal  Processor  are  wide- 
ranging  and  should  have  a  large  impact  on  the  development  of 
advanced  VLSI  signal  processing  systems. 


6- 3/6- 4 


APPENDIX  A 


The  simplified  block  diagram  of  the  adaptive  filter  shown  in 
figure  A-1  is  used  to  calculate  the  convergence  factor.  For  a 
given  tap  output,  x,  ,  the  weighted  output  voltage,  v  (m) ,  is 

K  O 

given  by 

vQ(m)  =  R  (gjs<m)  -  9ds(m))  Xk  (m) 
which  yields  an  effective  weight 


Wk(m)  =  vq (m)/xk (m) 

=  r  (g^on)  -  gds(m)) 

where : 

9ds(m)  =  I  Cox  t  (Vgw+(m)  "  V 
=  0<v£w  (m)  -  VT) 

Wm)  =  /3(V"W  (m)  -  VT) 

Referring  to  the  figure 

9dS""+1>  -4VGW(,”>  +  Gf  °  3I « I  -  Vt] 

dL 

where : 


4  error  channel  gain 
=  Rext  R  (see  figure  A-1) 


GBC3  =  ga:*-n  BC  circuit 

c2 

=  —  (see  figure  A-1) 

cg 
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